-- Logs begin at Thu 2022-08-18 19:56:45 UTC, end at Thu 2022-08-18 21:26:04 UTC. -- Aug 18 20:51:20.521847 dv-cinder-852208-8-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 18 20:51:20.531204 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 18 20:51:20 2022] *** Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: nodename: dv-cinder-852208-8-iscsi Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: machine: x86_64 Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: clock source: unix Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: pcre jit disabled Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: detected number of CPU cores: 4 Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: current working directory: / Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: detected binary path: /usr/bin/uwsgi-core Aug 18 20:51:20.533056 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: your processes number limit is 47680 Aug 18 20:51:20.533686 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: your memory page size is 4096 bytes Aug 18 20:51:20.533686 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: detected max file descriptor number: 2048 Aug 18 20:51:20.533686 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: lock engine: pthread robust mutexes Aug 18 20:51:20.533686 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: thunder lock: enabled Aug 18 20:51:20.533686 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 18 20:51:20.533686 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 18 20:51:20.572553 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: Python main interpreter initialized at 0x562ead3059c0 Aug 18 20:51:20.572553 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: python threads support enabled Aug 18 20:51:20.572553 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: your server socket listen backlog is limited to 100 connections Aug 18 20:51:20.572553 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: your mercy for graceful operations on workers is 90 seconds Aug 18 20:51:20.572932 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: mapped 403077 bytes (393 KB) for 2 cores Aug 18 20:51:20.572932 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: *** Operational MODE: preforking *** Aug 18 20:51:20.573246 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: *** uWSGI is running in multiple interpreter mode *** Aug 18 20:51:20.573246 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: spawned uWSGI master process (pid: 81575) Aug 18 20:51:20.573470 dv-cinder-852208-8-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 18 20:51:20.577172 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: spawned uWSGI worker 1 (pid: 81586, cores: 1) Aug 18 20:51:20.577172 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: spawned uWSGI worker 2 (pid: 81587, cores: 1) Aug 18 20:51:20.577172 dv-cinder-852208-8-iscsi devstack@keystone.service[81575]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 18 20:51:24.828880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:51:24.828880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: from cryptography.utils import int_from_bytes Aug 18 20:51:24.829651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:51:24.829651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: from cryptography.utils import int_from_bytes Aug 18 20:51:24.837284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:51:24.837284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: from cryptography.utils import int_from_bytes Aug 18 20:51:24.837794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 18 20:51:24.837794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: from cryptography.utils import int_from_bytes Aug 18 20:51:24.878666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:51:24.878886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:51:24.879067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] command line args: [] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:51:24.879330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:51:24.879461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ================================================================================ {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:51:24.879752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] admin_token = **** {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.879999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] config_dir = [] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.880193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.880357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] config_source = [] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.880576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] debug = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.880756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.881155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.881314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.881589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.881822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.882056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] list_limit = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.882234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] log_config_append = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.882421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.882596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] log_dir = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.882758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] log_file = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.883020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.883285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.883518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.883767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.883946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.884124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.884370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.884503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 18 20:51:24.884601 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.884681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 18 20:51:24.884866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] command line args: [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 18 20:51:24.884955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.885098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.885185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 18 20:51:24.885285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ================================================================================ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 18 20:51:24.885365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.885530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] admin_token = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.885614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.885770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] config_dir = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.885851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.885971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.886118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.886204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] config_source = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.886279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.886352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] debug = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.886490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.886797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.886901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.886980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] publish_errors = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.887046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.887215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.887342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.887489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.887561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.887708 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.887799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.887874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] log_config_append = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.887964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.888074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.888200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] log_dir = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.888308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.888390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] log_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.888462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] standard_threads = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.888590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.888689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.888829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.888937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.889054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.889141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.889234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] use_journal = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.889314 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.889410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] use_json = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.889495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.889589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] use_stderr = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.889667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.889767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] use_syslog = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.889850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.890002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.890089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.890265 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.890343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.890489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.890577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.890715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.890817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.890974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.891058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.891220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.891309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.891460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.891539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.891716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.891794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.891960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.892201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.892283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.892377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] publish_errors = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.892454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.892602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.892685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.892822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.892919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.892996 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.893169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.893264 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.893411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.893489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.893642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] standard_threads = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.893724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.893867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.893955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.894103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.894179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.894276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.894353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.894449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] use_journal = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.894604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.894682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] use_json = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.894786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] use_stderr = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.894865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.894971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] use_syslog = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.895103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.895191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 18 20:51:24.895361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.895446 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.895627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.895704 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.895884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.895970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.896116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.896192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.896673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.896756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.896901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.896984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.897132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.897214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.897368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.897445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.897615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.897694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.897856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.897934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.898086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.898163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.898317 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.898394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.898558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.898635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.898812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.898893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.899060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.899139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.899300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.899378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.899533 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.899617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.899773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.899857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.900010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.900089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.900242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.900320 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.900470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.900548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.900700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.900784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.900935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.901021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.901176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.901255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.901417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.901505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.901644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.901728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.901870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.901949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.902094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.902171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.902492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.902991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903095 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.903979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.904129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.904215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.904367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.904450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.904588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.904665 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.904819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.904905 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.905057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.905135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.905281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.905393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.905499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.905598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.905715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.905820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.905930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.906029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.906141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.906248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.906381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.906462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.906620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.906709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.906860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.906952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.907063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.907141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.907291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.907372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.907519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.907609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.907762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.907847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.908003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.908108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.908223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.908307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.908457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.908602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.908686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.908759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.908904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.909023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.909118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.909217 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.909344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.909465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.909586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.909705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.909815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.909944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.910046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.910182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.910261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.910421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.910508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.910657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.910737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.910955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.911037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.911185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.911272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.911418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.911503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.911654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.911733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.911895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.911981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.912131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.912210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.912366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.912445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.912596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.912683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.912826 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.912905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.913052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.913131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.913281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.913367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.913510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.913590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.913737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.913814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.913971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.914059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.914203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.914283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.914434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.914513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.914665 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.914899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.914979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.915051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.915121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.915195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.915379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.915466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.915613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.915693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] auth.external = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.915849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.915927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.916081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.916159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.916319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.916399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.916551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.916629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] auth.password = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.916782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.916861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] auth.token = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.917018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.917097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.917244 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.917323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.917468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.917555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.917694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.917773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.917971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.918471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.918471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.918685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.918819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.918905 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.918905 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] credential.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.919047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.919117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.919188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.919291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.919383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.919541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.919628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.919780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.919860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.920023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.920101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.920251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.external = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.920331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.920478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.920558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.920742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.920821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.920980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.921067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.921205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.password = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.921289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.921431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] auth.token = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.921511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.921666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.921745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.921899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.921977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.922141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.922219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.922367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.922447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.922610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.922690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] federation.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.922880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.922964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.923107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.923188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.923337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.923416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.923580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.923660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.923823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.923909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.924064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.924144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.924295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.924382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.924533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.924612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.924764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.924842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.925011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.925097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.925260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.925337 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.925491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.925570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.925738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.925825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.925989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.926070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.926230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.926309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.926467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.926555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.926708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.926802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.926966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.927045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.927207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.927301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.927436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.927516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.927676 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.927756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.927916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.928004 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.928140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.928220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.928371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.928449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.928599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.928754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.928831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.928907 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.929064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.929143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.929312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.929399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.929541 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.929621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.929783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.929870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.930013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.930105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.930254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.930339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.930485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.930563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.930713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.930920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.931002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.931081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.931195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.931276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.931438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.931526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.931680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.931760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.931931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.932010 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.932164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.932253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.932418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.932498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.932642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.932719 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.932872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.932959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.933111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.933245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.933352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.933520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.933756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.934283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.934283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.934421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.934493 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.934566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.934647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.934727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.934822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.934891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.934975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.935050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.935170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.935252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.935409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.935489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.935664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.935743 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.935892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.935971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.936127 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.936207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.936358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.936436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.936595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.936675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.936820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.936899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.937068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.937147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.937304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.937383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.937529 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.937607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.937759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.937837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.937996 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.938076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.938219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.938299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.938451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.938530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.938674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.938754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.938931 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.939012 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.939164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.939243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.939400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.939480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.939632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.939712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.939862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.939942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.940096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.940175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.940334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.940413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.940556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.940633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.940781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.940861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.941021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.941100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.941261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.941339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.941491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.941571 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.941722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.941801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.941950 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.942028 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.942171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.942251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.942406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.942489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.942647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.942725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.942900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.942981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.943134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.943212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.943373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.943451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.943613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.943693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.943842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.943921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.944069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.944161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.944337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.944470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.944548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.944620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.944743 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.944824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.944966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.945046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.945206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.945284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.945441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.945519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.945682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.945763 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.945909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.945987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.946146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.946224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.946370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.946458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] resource.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.946609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.946689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.946864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.946948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.947099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.947180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.947329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.947408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.947560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.947638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.947799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.947879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.948039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.948118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.948270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.948348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.948505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.948584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.948729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.948807 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] role.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.948969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.949057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] role.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.949230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.949361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.949461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.949584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.949712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.949803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.949960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.950041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.950207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.950287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.950442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.950529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.950674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.950753 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.950933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.951014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.951178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.951351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.951430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.951504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.951639 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.951763 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.951889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.951996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.952133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.952213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.952363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.952442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.952604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.952769 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.952849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.953008 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.953088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.953259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.953339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] role.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.953497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] role.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.953576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.953722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.953802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.953964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.954043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.954200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.954280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.954438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.954516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.954678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.954756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.954940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.955021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.955174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.955253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.955409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.955493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.955642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.955722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.955865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.955943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.956105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.956193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.956347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.956425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.956588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.956667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.956822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.956908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.957053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.957212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.957292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] token.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.957445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.957525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.957692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.957772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.957936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.958015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.958180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.958260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.958422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.958502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.958651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.958730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.958923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.959051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.959176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.959308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.959426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.959547 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.959666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.959779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.959908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.960009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.960144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.960223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.960389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.960469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.960638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.960718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.960869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.960948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.961116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.961195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.961383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.961463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.961611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.961690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.connection = **** {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.961842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] token.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.961930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.962075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.962162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.962319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.962398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.962550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.962629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.962821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.962918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.963068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.963155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.963300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.963376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.963535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.963621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.963768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.963846 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.964004 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.964082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.964232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.964318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.964467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.964546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.964696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.964781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.965034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.965455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.965535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.965609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.965681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.965753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.965824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.965905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.965979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.966052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.966124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81587) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:51:24.966283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.966523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.966777 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.967026 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.967263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.967495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.967728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.967958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.968189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.968429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.968659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.968898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.969128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.969369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.969598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.969836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.970062 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.970296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.970524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 18 20:51:24.970690 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81586) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 18 20:51:24.995154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:24.995339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:24.995592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:24.996534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:24.996534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:24.996855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.004405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.005314 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.032569 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.032769 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.033738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.034009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.086232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.086726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.134705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.134901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.135057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.135207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.292020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.292282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.292461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.292542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.292783 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.293081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.293206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.293359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.293809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.294001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.294233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.294436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.315822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.316067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.316198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.316291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.316373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.316470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.316561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.316719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.316858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.316930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.316992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.317140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.317266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.317350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.328351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.328480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.341089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.341305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.341541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.341709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.341806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.341961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.342091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.342160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.342236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.342315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81587) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.342377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.342548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.342797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.343023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81586) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 18 20:51:25.359142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.359409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:51:25.359692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.359816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.359964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:51:25.360109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:51:25.360237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.360366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.360447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.360566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 18 20:51:25.360657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.360903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.361099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.361235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.361363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.361487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.370424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.370700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.370903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.370998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.371571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.371758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.371856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.371856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.378358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.378677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.381243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.381529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.381654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.381801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.381947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.382091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.382196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.382378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.382477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.382612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.382734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.382900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.383065 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.383189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.383315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.383438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.383568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.383697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.383820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.383959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.384083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.384206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.406633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.407023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.408110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.408390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.408500 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.408738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.413012 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.413201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.413328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.413505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.413668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.413756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.419955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.420242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.420383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.420593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.424300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.424590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.424714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.424874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.425001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.425127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.425219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.425428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.425555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.425697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.425841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.425941 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.426237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.427652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.427940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.428224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.445600 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.445896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.447409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.447705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.450005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.451670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.453462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.453758 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.456381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.456684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.458077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.460854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.461246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.463996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.464352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.464645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.464983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.465265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.465569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.466107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.467610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.467911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.468204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.468490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.468769 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.469034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.481784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.482070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.482346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.482609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.484925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.485227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.485496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.485775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.489410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.491082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.491366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.492597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.493981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.494108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.494238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.494367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.494535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.494826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.495138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.497113 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.497403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.497686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.497983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.498247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.506333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.506612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.506918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.507189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.507469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.507754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.508036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.509475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.509761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.510039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.510320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.510596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.510900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.511166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.523754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.526623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.526823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.529790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.530037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.531258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.532715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.532992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.533181 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.533274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.534516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.536016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.536300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.536591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.539889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.541345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.543143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.544334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.544627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.544913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.545034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.545178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.548033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.548331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.548619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.548909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.553251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.553538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.553812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.556768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.557061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.557345 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.560947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81586) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.561330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.561611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.561887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.562175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.562462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.562734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.563037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.563316 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.563596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.563854 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.564130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.564215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81587) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 18 20:51:25.564392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.564495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.564646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81586) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.564761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.565049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.565324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.565596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.565879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.566149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.566412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.566691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.566991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.567258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.567544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.567804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81587) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 18 20:51:25.598256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562ead3059c0 pid: 81586 (default app) Aug 18 20:51:25.601517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x562ead3059c0 pid: 81587 (default app) Aug 18 20:51:25.601811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eda7c-77a3-4cea-9607-30a000444651 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:25.602100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eda7c-77a3-4cea-9607-30a000444651 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:25.602444 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660eda7c-77a3-4cea-9607-30a000444651 None None] PATH_INFO: `/v3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:25.606816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Thu Aug 18 20:51:25 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:32.239403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb68745-e406-468f-a2cb-8b7dc93dd17c None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:32.240059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb68745-e406-468f-a2cb-8b7dc93dd17c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:32.240348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb68745-e406-468f-a2cb-8b7dc93dd17c None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:32.244787 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:51:32.251430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:32.251889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:32.251974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:32.342090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: INFO dbcounter [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] Registered counter for database keystone Aug 18 20:51:32.364651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG oslo_db.sqlalchemy.engines [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81586) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:51:32.372751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writer thread running {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:51:32.598616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG passlib.handlers.bcrypt [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81586) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 20:51:32.599067 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG passlib.handlers.bcrypt [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81586) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 20:51:32.657397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:32.659039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:32.794439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:32 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 545 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 20:51:33.311712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb68745-e406-468f-a2cb-8b7dc93dd17c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:33.396699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: INFO dbcounter [None req-bbb68745-e406-468f-a2cb-8b7dc93dd17c None None] Registered counter for database keystone Aug 18 20:51:33.425346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG oslo_db.sqlalchemy.engines [None req-bbb68745-e406-468f-a2cb-8b7dc93dd17c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81587) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 18 20:51:33.438227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writer thread running {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 18 20:51:33.565878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb68745-e406-468f-a2cb-8b7dc93dd17c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:33.571027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b20043-2507-46c1-88ed-755d2d586201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:33.571666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b20043-2507-46c1-88ed-755d2d586201 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:33.571945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b20043-2507-46c1-88ed-755d2d586201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:33.572218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b20043-2507-46c1-88ed-755d2d586201 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:33.581540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b20043-2507-46c1-88ed-755d2d586201 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:33.633982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: WARNING keystone.common.rbac_enforcer.enforcer [None req-c2b20043-2507-46c1-88ed-755d2d586201 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 20:51:33.634335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b20043-2507-46c1-88ed-755d2d586201 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:33.645758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Thu Aug 18 20:51:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:51:33.656152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:33.676239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca946219-cffc-4250-9894-2be853f70b7e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:33.682126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9440aea6-fa1f-4cd9-b12f-c32e64890bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:33.683286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440aea6-fa1f-4cd9-b12f-c32e64890bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:33.683615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440aea6-fa1f-4cd9-b12f-c32e64890bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:33.683880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9440aea6-fa1f-4cd9-b12f-c32e64890bb0 admin admin] PATH_INFO: `/v3/projects/4e6b4204a03c4768887ce19cd521bf6b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:33.685604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440aea6-fa1f-4cd9-b12f-c32e64890bb0 admin admin] RBAC: Authorizing `identity:get_project(project_id=4e6b4204a03c4768887ce19cd521bf6b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:33.737212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9440aea6-fa1f-4cd9-b12f-c32e64890bb0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 18 20:51:33.737552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9440aea6-fa1f-4cd9-b12f-c32e64890bb0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:33.742199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Thu Aug 18 20:51:33 2022] GET /identity/v3/projects/4e6b4204a03c4768887ce19cd521bf6b => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:35.627704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291e2a-9616-4a02-bc01-6d4dbbcbde61 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:35.628573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291e2a-9616-4a02-bc01-6d4dbbcbde61 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:35.628573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47291e2a-9616-4a02-bc01-6d4dbbcbde61 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:35.635369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:35 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:35.642278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ae8b5-565e-40d9-9c24-81414e963285 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:35.642728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ae8b5-565e-40d9-9c24-81414e963285 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:35.642854 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ae8b5-565e-40d9-9c24-81414e963285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:35.673899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5e3ae8b5-565e-40d9-9c24-81414e963285 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:35.675472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5e3ae8b5-565e-40d9-9c24-81414e963285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:35.685684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:35 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 18 20:51:35.954471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47291e2a-9616-4a02-bc01-6d4dbbcbde61 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:35.972192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47291e2a-9616-4a02-bc01-6d4dbbcbde61 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:35.976714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37799fd6-5e03-4850-a649-f4a2d8e827b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:35.977330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799fd6-5e03-4850-a649-f4a2d8e827b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:35.977610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799fd6-5e03-4850-a649-f4a2d8e827b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:35.977880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37799fd6-5e03-4850-a649-f4a2d8e827b9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:35.987957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799fd6-5e03-4850-a649-f4a2d8e827b9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:35.989755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37799fd6-5e03-4850-a649-f4a2d8e827b9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:35.999297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Thu Aug 18 20:51:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:51:36.005376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ae8b5-565e-40d9-9c24-81414e963285 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:36.015480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ae8b5-565e-40d9-9c24-81414e963285 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:36.022343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc823f80-90db-45ea-8045-c38b82905af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:36.023008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc823f80-90db-45ea-8045-c38b82905af4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:36.023288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc823f80-90db-45ea-8045-c38b82905af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:36.023560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc823f80-90db-45ea-8045-c38b82905af4 admin admin] PATH_INFO: `/v3/users/6f68b08e3d424c04b847f9123ed23bfd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:36.025031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc823f80-90db-45ea-8045-c38b82905af4 admin admin] RBAC: Authorizing `identity:get_user(user_id=6f68b08e3d424c04b847f9123ed23bfd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:36.026920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc823f80-90db-45ea-8045-c38b82905af4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:36.028514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Thu Aug 18 20:51:36 2022] GET /identity/v3/users/6f68b08e3d424c04b847f9123ed23bfd => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:37.988659 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f342-165a-48c2-8b6b-33fcf928e7d0 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:37.989211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f342-165a-48c2-8b6b-33fcf928e7d0 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:37.989211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4089f342-165a-48c2-8b6b-33fcf928e7d0 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:37.990554 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:37.996671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c358982-cd93-4902-a640-5e2040663b74 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:37.997114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c358982-cd93-4902-a640-5e2040663b74 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:37.997202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c358982-cd93-4902-a640-5e2040663b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:38.016573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1c358982-cd93-4902-a640-5e2040663b74 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:38.017759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1c358982-cd93-4902-a640-5e2040663b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:38.059735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e828a-9e18-40d5-834b-e26f55bb34b7 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:38.060017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e828a-9e18-40d5-834b-e26f55bb34b7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:38.060367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766e828a-9e18-40d5-834b-e26f55bb34b7 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:38.061780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:38.069007 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dd0bd-6031-4fca-ac2e-d03cac403bd6 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:38.069299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dd0bd-6031-4fca-ac2e-d03cac403bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:38.069606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9dd0bd-6031-4fca-ac2e-d03cac403bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:38.108232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:38.112350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG passlib.handlers.bcrypt [None req-3a9dd0bd-6031-4fca-ac2e-d03cac403bd6 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81587) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 18 20:51:38.112772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG passlib.handlers.bcrypt [None req-3a9dd0bd-6031-4fca-ac2e-d03cac403bd6 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81587) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 18 20:51:38.157987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-3a9dd0bd-6031-4fca-ac2e-d03cac403bd6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:38.159588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3a9dd0bd-6031-4fca-ac2e-d03cac403bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:38.259788 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:38.370348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c358982-cd93-4902-a640-5e2040663b74 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:38.396929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:38.478520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c358982-cd93-4902-a640-5e2040663b74 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:38.512349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cac3f-2f8f-47ff-bc34-250ec63ac333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:38.512983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cac3f-2f8f-47ff-bc34-250ec63ac333 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:38.513262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cac3f-2f8f-47ff-bc34-250ec63ac333 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:38.513534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10cac3f-2f8f-47ff-bc34-250ec63ac333 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:38.525288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10cac3f-2f8f-47ff-bc34-250ec63ac333 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f10cac3f-2f8f-47ff-bc34-250ec63ac333 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:38.534650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:38.535606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:51:38.536405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:51:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:51:38.540847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dd0bd-6031-4fca-ac2e-d03cac403bd6 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:38.541388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cac3f-2f8f-47ff-bc34-250ec63ac333 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:38.629420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:38.647844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9dd0bd-6031-4fca-ac2e-d03cac403bd6 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:38.648661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10cac3f-2f8f-47ff-bc34-250ec63ac333 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:38.650353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:38.684761 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb66eb-bc56-42d2-a104-913c850dc540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:38.685377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb66eb-bc56-42d2-a104-913c850dc540 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:38.685656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb66eb-bc56-42d2-a104-913c850dc540 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:38.685925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fb66eb-bc56-42d2-a104-913c850dc540 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:38.686603 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb66eb-bc56-42d2-a104-913c850dc540 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:38.686934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb66eb-bc56-42d2-a104-913c850dc540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:38.688327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fb66eb-bc56-42d2-a104-913c850dc540 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:38.689151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d468c9-e95e-4401-9aae-c45aa876262c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:38.690017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d468c9-e95e-4401-9aae-c45aa876262c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:38.690296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d468c9-e95e-4401-9aae-c45aa876262c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:38.690594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d468c9-e95e-4401-9aae-c45aa876262c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:38.700057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:51:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:38.705548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb66eb-bc56-42d2-a104-913c850dc540 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:38.759940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d468c9-e95e-4401-9aae-c45aa876262c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:38.761524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d468c9-e95e-4401-9aae-c45aa876262c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:38.804183 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fb66eb-bc56-42d2-a104-913c850dc540 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:38.838082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dbc60-42c5-4dfe-adb2-546d2aad6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:38.838815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dbc60-42c5-4dfe-adb2-546d2aad6f43 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:38.839099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dbc60-42c5-4dfe-adb2-546d2aad6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:38.839373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4dbc60-42c5-4dfe-adb2-546d2aad6f43 None admin] PATH_INFO: `/v3/users/6f68b08e3d424c04b847f9123ed23bfd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:38.840659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dbc60-42c5-4dfe-adb2-546d2aad6f43 None admin] RBAC: Authorizing `identity:get_user(user_id=6f68b08e3d424c04b847f9123ed23bfd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:38.842181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4dbc60-42c5-4dfe-adb2-546d2aad6f43 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:38.843734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 9/16] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:38 2022] GET /identity/v3/users/6f68b08e3d424c04b847f9123ed23bfd => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:51:38.849395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dbc60-42c5-4dfe-adb2-546d2aad6f43 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:38.861165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 8/17] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:51:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:51:38.866639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d468c9-e95e-4401-9aae-c45aa876262c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:38.867509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:38.869981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:38.955912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4dbc60-42c5-4dfe-adb2-546d2aad6f43 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:38.969886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d468c9-e95e-4401-9aae-c45aa876262c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:38.990450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7811d79-8845-410c-8540-8692a920ba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:38.991153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7811d79-8845-410c-8540-8692a920ba3f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:38.991435 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7811d79-8845-410c-8540-8692a920ba3f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:38.991692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7811d79-8845-410c-8540-8692a920ba3f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:38.992850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7811d79-8845-410c-8540-8692a920ba3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:38.994333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7811d79-8845-410c-8540-8692a920ba3f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:39.001407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 10/18] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:51:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:51:39.002438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7811d79-8845-410c-8540-8692a920ba3f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:39.004006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894a915-09a3-4485-91f5-cafa857db8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:39.004861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894a915-09a3-4485-91f5-cafa857db8f2 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:39.005144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894a915-09a3-4485-91f5-cafa857db8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:39.005420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8894a915-09a3-4485-91f5-cafa857db8f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:39.024473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894a915-09a3-4485-91f5-cafa857db8f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:39.025962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8894a915-09a3-4485-91f5-cafa857db8f2 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-8894a915-09a3-4485-91f5-cafa857db8f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:51:39.045123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:39.046214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:51:39.047055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:51:39.047055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:51:39.047055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:51:39.047055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 9/19] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:51:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:51:39.052670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894a915-09a3-4485-91f5-cafa857db8f2 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:39.091226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:39.111101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7811d79-8845-410c-8540-8692a920ba3f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:39.111889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:39.145360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647306ce-b775-4589-ba95-cf8edc84a44d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:39.145965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647306ce-b775-4589-ba95-cf8edc84a44d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:39.146542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647306ce-b775-4589-ba95-cf8edc84a44d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:39.146849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647306ce-b775-4589-ba95-cf8edc84a44d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:39.147579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647306ce-b775-4589-ba95-cf8edc84a44d None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.domain.id=default, user.id=6f68b08e3d424c04b847f9123ed23bfd) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:39.147881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647306ce-b775-4589-ba95-cf8edc84a44d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:39.149332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647306ce-b775-4589-ba95-cf8edc84a44d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:39.155935 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 11/20] 10.222.0.59 () {56 vars in 1322 bytes} [Thu Aug 18 20:51:39 2022] GET /identity/v3/role_assignments?user.id=6f68b08e3d424c04b847f9123ed23bfd&scope.domain.id=default&role.id=85a146946817410b9a3addcf041c5909 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:39.156462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8894a915-09a3-4485-91f5-cafa857db8f2 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:39.193048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ded85a-b1b9-41c6-9888-8304b427b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:39.193680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ded85a-b1b9-41c6-9888-8304b427b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:39.193963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ded85a-b1b9-41c6-9888-8304b427b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:39.194237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ded85a-b1b9-41c6-9888-8304b427b7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:39.194937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ded85a-b1b9-41c6-9888-8304b427b7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:39.195242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ded85a-b1b9-41c6-9888-8304b427b7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:39.196658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ded85a-b1b9-41c6-9888-8304b427b7f9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:39.216741 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 10/21] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:51:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:51:41.246382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc9d66-b4cf-4d1f-b032-9756cdd40b90 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:41.247434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc9d66-b4cf-4d1f-b032-9756cdd40b90 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:41.247869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cc9d66-b4cf-4d1f-b032-9756cdd40b90 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:41.249658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 12/22] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:41.255341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e444a3-c225-4669-bec6-da2a1225513a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:41.256214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e444a3-c225-4669-bec6-da2a1225513a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:41.256685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e444a3-c225-4669-bec6-da2a1225513a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:41.283149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-81e444a3-c225-4669-bec6-da2a1225513a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:41.284712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-81e444a3-c225-4669-bec6-da2a1225513a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:41.373869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:41.424895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eb48a-67fb-4940-a35e-95fc88c88ab7 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:41.425543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eb48a-67fb-4940-a35e-95fc88c88ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:41.426030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eb48a-67fb-4940-a35e-95fc88c88ab7 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:41.427618 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:41.441228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4c233-33a3-42ef-96d6-b18cbc80cee3 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:41.441511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4c233-33a3-42ef-96d6-b18cbc80cee3 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:41.441966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4c233-33a3-42ef-96d6-b18cbc80cee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:41.468187 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-96c4c233-33a3-42ef-96d6-b18cbc80cee3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:41.469728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-96c4c233-33a3-42ef-96d6-b18cbc80cee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:41.529309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:41.560778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 12/25] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:41.712784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c83244-1a09-4b21-83b3-f33f0bfcd096 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:41.713409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c83244-1a09-4b21-83b3-f33f0bfcd096 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:41.713901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c83244-1a09-4b21-83b3-f33f0bfcd096 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:41.717086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 14/26] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:41.722821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf577-2274-4316-be2b-b25be13cdbff None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:41.723117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf577-2274-4316-be2b-b25be13cdbff None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:41.723398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdbf577-2274-4316-be2b-b25be13cdbff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:41.748488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-8cdbf577-2274-4316-be2b-b25be13cdbff None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:41.749701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8cdbf577-2274-4316-be2b-b25be13cdbff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:41.815514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c83244-1a09-4b21-83b3-f33f0bfcd096 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:41.860304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 13/27] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:41.988415 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c83244-1a09-4b21-83b3-f33f0bfcd096 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:42.037268 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e1df2-365d-4a4a-b604-c3f457d7407d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:42.037915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e1df2-365d-4a4a-b604-c3f457d7407d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:42.038196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e1df2-365d-4a4a-b604-c3f457d7407d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:42.038464 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3e1df2-365d-4a4a-b604-c3f457d7407d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:42.051293 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3e1df2-365d-4a4a-b604-c3f457d7407d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5e3e1df2-365d-4a4a-b604-c3f457d7407d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:42.056666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:42.057539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:51:42.058342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 15/28] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:51:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:51:42.067707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbf577-2274-4316-be2b-b25be13cdbff None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:42.120807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e1df2-365d-4a4a-b604-c3f457d7407d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:42.125683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:42.241251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdbf577-2274-4316-be2b-b25be13cdbff None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:42.249105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:42.275716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3e1df2-365d-4a4a-b604-c3f457d7407d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:42.281776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e46d37-1a36-4d99-8d1f-9c02de82618a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:42.282398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e46d37-1a36-4d99-8d1f-9c02de82618a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:42.282673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e46d37-1a36-4d99-8d1f-9c02de82618a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:42.282969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e46d37-1a36-4d99-8d1f-9c02de82618a None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:42.283736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e46d37-1a36-4d99-8d1f-9c02de82618a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:42.284038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e46d37-1a36-4d99-8d1f-9c02de82618a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:42.285521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e46d37-1a36-4d99-8d1f-9c02de82618a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:42.298555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 14/29] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:51:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:42.304308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df75308-9796-4d08-b006-6c417b8de648 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:42.304706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df75308-9796-4d08-b006-6c417b8de648 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:42.304987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df75308-9796-4d08-b006-6c417b8de648 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:42.306329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 15/30] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:42.307123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df75308-9796-4d08-b006-6c417b8de648 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:42.316566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0378dc2-4dea-4422-8ed8-f43c9a9e38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:42.317201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0378dc2-4dea-4422-8ed8-f43c9a9e38ed None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:42.317487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0378dc2-4dea-4422-8ed8-f43c9a9e38ed None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:42.317806 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0378dc2-4dea-4422-8ed8-f43c9a9e38ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:42.328832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0378dc2-4dea-4422-8ed8-f43c9a9e38ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:42.330382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0378dc2-4dea-4422-8ed8-f43c9a9e38ed None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f0378dc2-4dea-4422-8ed8-f43c9a9e38ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:51:42.345794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:42.346707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:51:42.347924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:51:42.347924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:51:42.347924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:51:42.347924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 16/31] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:51:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:51:42.348137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0378dc2-4dea-4422-8ed8-f43c9a9e38ed None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:42.408121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:42.420915 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df75308-9796-4d08-b006-6c417b8de648 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:42.455801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0378dc2-4dea-4422-8ed8-f43c9a9e38ed None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:42.457473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1586653-896e-413e-81bf-81b25c3221d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:42.458370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1586653-896e-413e-81bf-81b25c3221d6 None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:42.458807 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1586653-896e-413e-81bf-81b25c3221d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:42.459252 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1586653-896e-413e-81bf-81b25c3221d6 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:42.460087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1586653-896e-413e-81bf-81b25c3221d6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:42.461629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1586653-896e-413e-81bf-81b25c3221d6 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:42.492224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e711748e-59f3-4fb1-9a0f-90281aeb35ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:42.492859 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711748e-59f3-4fb1-9a0f-90281aeb35ec None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:42.493136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711748e-59f3-4fb1-9a0f-90281aeb35ec None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:42.493414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e711748e-59f3-4fb1-9a0f-90281aeb35ec None admin] PATH_INFO: `/v3/users/6f68b08e3d424c04b847f9123ed23bfd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:42.494562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711748e-59f3-4fb1-9a0f-90281aeb35ec None admin] RBAC: Authorizing `identity:get_user(user_id=6f68b08e3d424c04b847f9123ed23bfd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:42.496134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e711748e-59f3-4fb1-9a0f-90281aeb35ec None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:42.502672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 17/32] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:42 2022] GET /identity/v3/users/6f68b08e3d424c04b847f9123ed23bfd => generated 247 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:42.502672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102593-22ab-4152-a3c7-a3e42a17f559 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:42.502672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102593-22ab-4152-a3c7-a3e42a17f559 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:42.502672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c102593-22ab-4152-a3c7-a3e42a17f559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:42.519969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5c102593-22ab-4152-a3c7-a3e42a17f559 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:42.521525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5c102593-22ab-4152-a3c7-a3e42a17f559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:42.597338 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 18/33] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:42.597338 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c102593-22ab-4152-a3c7-a3e42a17f559 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:42.610955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 16/34] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Aug 18 20:51:42 2022] POST /identity/v3/roles => generated 219 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:51:42.612169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1586653-896e-413e-81bf-81b25c3221d6 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:42.674807 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:42.700064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:42.796364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1586653-896e-413e-81bf-81b25c3221d6 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:42.843484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c102593-22ab-4152-a3c7-a3e42a17f559 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:42.863918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997fe2d-a36e-4f2e-bdfe-910a17fe4271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:42.865338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997fe2d-a36e-4f2e-bdfe-910a17fe4271 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:42.866025 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997fe2d-a36e-4f2e-bdfe-910a17fe4271 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:42.866817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1997fe2d-a36e-4f2e-bdfe-910a17fe4271 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:42.872614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997fe2d-a36e-4f2e-bdfe-910a17fe4271 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:42.875778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1997fe2d-a36e-4f2e-bdfe-910a17fe4271 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:42.879256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 17/35] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:51:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:42.890096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997fe2d-a36e-4f2e-bdfe-910a17fe4271 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:42.947688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4c6ac-93b5-473e-b1a1-b3be8bc71d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:42.948357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c6ac-93b5-473e-b1a1-b3be8bc71d13 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:42.948645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c6ac-93b5-473e-b1a1-b3be8bc71d13 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:42.948922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a4c6ac-93b5-473e-b1a1-b3be8bc71d13 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:42.949761 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4c6ac-93b5-473e-b1a1-b3be8bc71d13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:42.949986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4c6ac-93b5-473e-b1a1-b3be8bc71d13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:42.951521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a4c6ac-93b5-473e-b1a1-b3be8bc71d13 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:42.986631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 19/36] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:51:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:42.992137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4c6ac-93b5-473e-b1a1-b3be8bc71d13 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:43.097511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:43.109634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1997fe2d-a36e-4f2e-bdfe-910a17fe4271 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:43.122114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a4c6ac-93b5-473e-b1a1-b3be8bc71d13 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:43.140322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:43.166867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40d255-7e4a-4bb6-bc37-9b1a16bfb498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:43.167948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d255-7e4a-4bb6-bc37-9b1a16bfb498 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.168431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d255-7e4a-4bb6-bc37-9b1a16bfb498 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.169079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40d255-7e4a-4bb6-bc37-9b1a16bfb498 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.169960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40d255-7e4a-4bb6-bc37-9b1a16bfb498 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:43.171681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40d255-7e4a-4bb6-bc37-9b1a16bfb498 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:43.175233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c5865-4b68-48bb-a2ab-01f48e002a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:43.176525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c5865-4b68-48bb-a2ab-01f48e002a78 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.177015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c5865-4b68-48bb-a2ab-01f48e002a78 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.177501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3c5865-4b68-48bb-a2ab-01f48e002a78 None admin] PATH_INFO: `/v3/domains/default/users/6f68b08e3d424c04b847f9123ed23bfd/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.182877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c5865-4b68-48bb-a2ab-01f48e002a78 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=6f68b08e3d424c04b847f9123ed23bfd, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:43.185643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3c5865-4b68-48bb-a2ab-01f48e002a78 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:43.211379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 18/37] 10.222.0.59 () {58 vars in 1361 bytes} [Thu Aug 18 20:51:42 2022] PUT /identity/v3/domains/default/users/6f68b08e3d424c04b847f9123ed23bfd/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:51:43.211379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c5865-4b68-48bb-a2ab-01f48e002a78 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:43.311863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 20/38] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:51:42 2022] POST /identity/v3/projects => generated 301 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:51:43.313418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f33866-bec6-42f5-bf43-b312517d82ad None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.313715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f33866-bec6-42f5-bf43-b312517d82ad None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.313993 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f33866-bec6-42f5-bf43-b312517d82ad None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.315276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 21/39] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:43.316370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93508004-7c94-42cf-96b3-202103af5f36 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.316654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93508004-7c94-42cf-96b3-202103af5f36 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.316944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93508004-7c94-42cf-96b3-202103af5f36 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.318203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 22/40] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:43.325209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb090-eda4-4ce6-ab20-d9d187a9acdd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.325627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb090-eda4-4ce6-ab20-d9d187a9acdd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.325769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfb090-eda4-4ce6-ab20-d9d187a9acdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.361570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-70dfb090-eda4-4ce6-ab20-d9d187a9acdd None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:43.363325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-70dfb090-eda4-4ce6-ab20-d9d187a9acdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:43.403225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3c5865-4b68-48bb-a2ab-01f48e002a78 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:43.455171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a045446b-405d-40fd-b953-98a974ebecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:43.455836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045446b-405d-40fd-b953-98a974ebecf4 None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.456156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045446b-405d-40fd-b953-98a974ebecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.456406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a045446b-405d-40fd-b953-98a974ebecf4 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.457131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045446b-405d-40fd-b953-98a974ebecf4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:43.458620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a045446b-405d-40fd-b953-98a974ebecf4 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:43.477406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 19/41] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Aug 18 20:51:43 2022] POST /identity/v3/roles => generated 225 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:51:43.478649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb0686-0cb3-45ac-bf4e-3f396a98017d None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:43.478936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb0686-0cb3-45ac-bf4e-3f396a98017d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:43.479243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eacb0686-0cb3-45ac-bf4e-3f396a98017d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:43.504257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-eacb0686-0cb3-45ac-bf4e-3f396a98017d None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:43.506928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-eacb0686-0cb3-45ac-bf4e-3f396a98017d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:43.522828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:43.566983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 23/42] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:51:43.598817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 20/43] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:43.851848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfb090-eda4-4ce6-ab20-d9d187a9acdd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:43.885683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb0686-0cb3-45ac-bf4e-3f396a98017d None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:43.966706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:43.973446 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfb090-eda4-4ce6-ab20-d9d187a9acdd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:44.005598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eacb0686-0cb3-45ac-bf4e-3f396a98017d None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:44.012191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20122e9-ab83-411a-b048-1e878d13bce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:44.012816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20122e9-ab83-411a-b048-1e878d13bce5 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:44.013099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20122e9-ab83-411a-b048-1e878d13bce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:44.013377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20122e9-ab83-411a-b048-1e878d13bce5 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:44.014048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20122e9-ab83-411a-b048-1e878d13bce5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:44.015608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20122e9-ab83-411a-b048-1e878d13bce5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:44.036699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 24/44] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Aug 18 20:51:43 2022] POST /identity/v3/roles => generated 223 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:51:44.050367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e0e81-2c11-425b-abb1-92c3d3e9ab62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:44.051165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e0e81-2c11-425b-abb1-92c3d3e9ab62 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:44.051452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e0e81-2c11-425b-abb1-92c3d3e9ab62 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:44.051724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e0e81-2c11-425b-abb1-92c3d3e9ab62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:44.053053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e0e81-2c11-425b-abb1-92c3d3e9ab62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:44.054639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e0e81-2c11-425b-abb1-92c3d3e9ab62 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:44.056640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 21/45] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:51:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:51:44.064375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20122e9-ab83-411a-b048-1e878d13bce5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:44.182404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20122e9-ab83-411a-b048-1e878d13bce5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:44.219281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01772be1-3447-4168-b5e1-d1179b235506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:44.219927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772be1-3447-4168-b5e1-d1179b235506 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:44.220208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772be1-3447-4168-b5e1-d1179b235506 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:44.220497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01772be1-3447-4168-b5e1-d1179b235506 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:44.221212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01772be1-3447-4168-b5e1-d1179b235506 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:44.222689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01772be1-3447-4168-b5e1-d1179b235506 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:44.250539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 25/46] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:51:44 2022] POST /identity/v3/projects => generated 312 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:51:45.294818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76500ab-e25c-49c4-9663-45858cdd31d5 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:45.295386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76500ab-e25c-49c4-9663-45858cdd31d5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:45.295386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76500ab-e25c-49c4-9663-45858cdd31d5 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:45.296909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 22/47] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:45.302483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd6a6-2d15-4daf-821b-5781bf8b701f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:45.302952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd6a6-2d15-4daf-821b-5781bf8b701f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:45.303289 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafbd6a6-2d15-4daf-821b-5781bf8b701f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:45.323664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bafbd6a6-2d15-4daf-821b-5781bf8b701f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:45.325349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bafbd6a6-2d15-4daf-821b-5781bf8b701f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:45.327492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:45.397707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 26/48] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:45.677742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76500ab-e25c-49c4-9663-45858cdd31d5 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:45.694680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:45.792469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76500ab-e25c-49c4-9663-45858cdd31d5 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:45.828703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb699-8ffb-41d4-93f8-c18a21a59eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:45.829343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb699-8ffb-41d4-93f8-c18a21a59eba None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:45.829620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb699-8ffb-41d4-93f8-c18a21a59eba None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:45.829892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236cb699-8ffb-41d4-93f8-c18a21a59eba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:45.841509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236cb699-8ffb-41d4-93f8-c18a21a59eba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-236cb699-8ffb-41d4-93f8-c18a21a59eba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:45.848656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:45.849503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:51:45.850384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 23/49] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:51:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:51:45.856086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbd6a6-2d15-4daf-821b-5781bf8b701f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:45.964526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafbd6a6-2d15-4daf-821b-5781bf8b701f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:46.000834 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369ecb6e-68f7-4a9a-bac5-d28cb4163ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:46.001463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ecb6e-68f7-4a9a-bac5-d28cb4163ce6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:46.001739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ecb6e-68f7-4a9a-bac5-d28cb4163ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:46.002014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369ecb6e-68f7-4a9a-bac5-d28cb4163ce6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:46.002685 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ecb6e-68f7-4a9a-bac5-d28cb4163ce6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:46.003018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ecb6e-68f7-4a9a-bac5-d28cb4163ce6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:46.004438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369ecb6e-68f7-4a9a-bac5-d28cb4163ce6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:46.009833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:46.013828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 27/50] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:51:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:51:46.019643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb699-8ffb-41d4-93f8-c18a21a59eba None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:46.128616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa598b2-0468-4f90-9a31-bc9956fa8370 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:46.128874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa598b2-0468-4f90-9a31-bc9956fa8370 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:46.129188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa598b2-0468-4f90-9a31-bc9956fa8370 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:46.130579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 28/51] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:46.135907 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bacc5-e87e-4ffa-8ef5-a83dc9c80cf1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:46.136192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bacc5-e87e-4ffa-8ef5-a83dc9c80cf1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:46.136476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572bacc5-e87e-4ffa-8ef5-a83dc9c80cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:46.156302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-572bacc5-e87e-4ffa-8ef5-a83dc9c80cf1 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:46.157580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-572bacc5-e87e-4ffa-8ef5-a83dc9c80cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:46.216074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:46.229161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 29/52] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:46.241657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236cb699-8ffb-41d4-93f8-c18a21a59eba None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:46.276155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edf53e-c302-46ea-9fc2-75509803def4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:46.276796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edf53e-c302-46ea-9fc2-75509803def4 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:46.277061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edf53e-c302-46ea-9fc2-75509803def4 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:46.277522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edf53e-c302-46ea-9fc2-75509803def4 None admin] PATH_INFO: `/v3/users/6f68b08e3d424c04b847f9123ed23bfd` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:46.278694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edf53e-c302-46ea-9fc2-75509803def4 None admin] RBAC: Authorizing `identity:get_user(user_id=6f68b08e3d424c04b847f9123ed23bfd)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:46.280199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edf53e-c302-46ea-9fc2-75509803def4 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:46.281809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 24/53] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:46 2022] GET /identity/v3/users/6f68b08e3d424c04b847f9123ed23bfd => generated 247 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:46.287671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bacc5-e87e-4ffa-8ef5-a83dc9c80cf1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:46.390609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572bacc5-e87e-4ffa-8ef5-a83dc9c80cf1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:46.421221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:46.428113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751543d2-a2af-48d5-99a1-d3250d3d1bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:46.428781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751543d2-a2af-48d5-99a1-d3250d3d1bae None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:46.429064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751543d2-a2af-48d5-99a1-d3250d3d1bae None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:46.429339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751543d2-a2af-48d5-99a1-d3250d3d1bae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:46.430509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751543d2-a2af-48d5-99a1-d3250d3d1bae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:46.432087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751543d2-a2af-48d5-99a1-d3250d3d1bae None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:46.434459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 30/54] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:51:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:46.440579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edf53e-c302-46ea-9fc2-75509803def4 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:46.492417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751543d2-a2af-48d5-99a1-d3250d3d1bae None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:46.544123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edf53e-c302-46ea-9fc2-75509803def4 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:46.577999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34976881-a14d-48bf-ba42-3b55a080a310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:46.578611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34976881-a14d-48bf-ba42-3b55a080a310 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:46.578922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34976881-a14d-48bf-ba42-3b55a080a310 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:46.579201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34976881-a14d-48bf-ba42-3b55a080a310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:46.579932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34976881-a14d-48bf-ba42-3b55a080a310 None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.domain.id=default, user.id=6f68b08e3d424c04b847f9123ed23bfd) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:46.580248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34976881-a14d-48bf-ba42-3b55a080a310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:46.581732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34976881-a14d-48bf-ba42-3b55a080a310 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:46.590876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 25/55] 10.222.0.59 () {56 vars in 1322 bytes} [Thu Aug 18 20:51:46 2022] GET /identity/v3/role_assignments?user.id=6f68b08e3d424c04b847f9123ed23bfd&scope.domain.id=default&role.id=85a146946817410b9a3addcf041c5909 => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:46.597738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751543d2-a2af-48d5-99a1-d3250d3d1bae None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:46.635964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a708e9-857a-4dac-9ca7-3b28d58560ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:46.636624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a708e9-857a-4dac-9ca7-3b28d58560ff None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:46.636903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a708e9-857a-4dac-9ca7-3b28d58560ff None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:46.637174 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a708e9-857a-4dac-9ca7-3b28d58560ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:46.638437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a708e9-857a-4dac-9ca7-3b28d58560ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:46.639965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a708e9-857a-4dac-9ca7-3b28d58560ff None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:46.641617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 31/56] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:51:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:46.647955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34976881-a14d-48bf-ba42-3b55a080a310 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:46.658239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:46.760907 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34976881-a14d-48bf-ba42-3b55a080a310 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:46.800864 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95f65fd-8816-4db7-b8b5-f95e156afa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:46.801495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f65fd-8816-4db7-b8b5-f95e156afa4a None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:46.801781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f65fd-8816-4db7-b8b5-f95e156afa4a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:46.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95f65fd-8816-4db7-b8b5-f95e156afa4a None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:46.802721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f65fd-8816-4db7-b8b5-f95e156afa4a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:46.804275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95f65fd-8816-4db7-b8b5-f95e156afa4a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:46.832900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 26/57] 10.222.0.59 () {60 vars in 1140 bytes} [Thu Aug 18 20:51:46 2022] POST /identity/v3/projects => generated 298 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:51:48.748336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd181b8c-d64e-4cad-8ace-7c45537c1618 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:48.748846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd181b8c-d64e-4cad-8ace-7c45537c1618 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:48.748951 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd181b8c-d64e-4cad-8ace-7c45537c1618 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:48.750802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 32/58] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:48.755862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99db83b-045a-46de-8382-5e1dff46e9a5 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:48.756653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99db83b-045a-46de-8382-5e1dff46e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:48.757109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99db83b-045a-46de-8382-5e1dff46e9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:48.778948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d99db83b-045a-46de-8382-5e1dff46e9a5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:48.780180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d99db83b-045a-46de-8382-5e1dff46e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:48.840048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:48.854793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 27/59] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:49.128283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd181b8c-d64e-4cad-8ace-7c45537c1618 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:49.199344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:49.238730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd181b8c-d64e-4cad-8ace-7c45537c1618 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:49.276210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d15c55-ba93-4716-924d-79fa764853a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:49.276841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d15c55-ba93-4716-924d-79fa764853a0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:49.277299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d15c55-ba93-4716-924d-79fa764853a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:49.277563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d15c55-ba93-4716-924d-79fa764853a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:49.278815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d15c55-ba93-4716-924d-79fa764853a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:49.280294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d15c55-ba93-4716-924d-79fa764853a0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:49.281891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 33/60] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:51:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:49.288713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99db83b-045a-46de-8382-5e1dff46e9a5 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:49.402103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99db83b-045a-46de-8382-5e1dff46e9a5 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:49.440259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e72a7-1050-4cbb-83bb-37d63d19914d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:49.440872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e72a7-1050-4cbb-83bb-37d63d19914d None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:49.441153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e72a7-1050-4cbb-83bb-37d63d19914d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:49.441425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e72a7-1050-4cbb-83bb-37d63d19914d None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:49.442068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e72a7-1050-4cbb-83bb-37d63d19914d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:49.443586 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e72a7-1050-4cbb-83bb-37d63d19914d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:49.472804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 28/61] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:51:49 2022] POST /identity/v3/users => generated 275 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:51:52.529530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654acf-e0cd-4ab0-8400-010669701079 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:52.530592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654acf-e0cd-4ab0-8400-010669701079 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:52.531099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc654acf-e0cd-4ab0-8400-010669701079 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:52.532988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 34/62] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:52.538182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77cb75-e002-4474-89d5-ce21a0b398ff None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:52.539033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77cb75-e002-4474-89d5-ce21a0b398ff None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:52.539507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e77cb75-e002-4474-89d5-ce21a0b398ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:52.567853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-4e77cb75-e002-4474-89d5-ce21a0b398ff None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:52.569439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4e77cb75-e002-4474-89d5-ce21a0b398ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:52.623471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:52.664158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 29/63] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:52.802319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bf4d6-685f-40f4-b8f0-2cbb1ca65415 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:52.802954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bf4d6-685f-40f4-b8f0-2cbb1ca65415 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:52.803430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6bf4d6-685f-40f4-b8f0-2cbb1ca65415 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:52.805011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 35/64] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:52.811111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68651c8-f9d6-4fd9-a944-5d5f6141f1d2 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:52.811659 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68651c8-f9d6-4fd9-a944-5d5f6141f1d2 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:52.812138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68651c8-f9d6-4fd9-a944-5d5f6141f1d2 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:52.813747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 30/65] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:52.818464 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9c9ab-0ab1-442c-b2a7-a4fda5e2e440 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:52.818754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9c9ab-0ab1-442c-b2a7-a4fda5e2e440 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:52.819052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9c9ab-0ab1-442c-b2a7-a4fda5e2e440 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:52.828105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda24e-f298-4046-ad59-71f528686810 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:52.828644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda24e-f298-4046-ad59-71f528686810 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:52.829118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fda24e-f298-4046-ad59-71f528686810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:52.845480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d6a9c9ab-0ab1-442c-b2a7-a4fda5e2e440 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:52.846734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d6a9c9ab-0ab1-442c-b2a7-a4fda5e2e440 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:52.848857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-94fda24e-f298-4046-ad59-71f528686810 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:52.850218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-94fda24e-f298-4046-ad59-71f528686810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:52.937510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 31/66] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:51:52.997286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 36/67] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:53.057216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651225c-c0e7-41a0-a624-2dedb496a90f None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.057835 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651225c-c0e7-41a0-a624-2dedb496a90f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.058597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7651225c-c0e7-41a0-a624-2dedb496a90f None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.061037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 32/68] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:53.066400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca6eb4-0cb5-49f0-91fc-c506ee83920d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.066692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca6eb4-0cb5-49f0-91fc-c506ee83920d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.067013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eca6eb4-0cb5-49f0-91fc-c506ee83920d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.071923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651225c-c0e7-41a0-a624-2dedb496a90f None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:53.087730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9eca6eb4-0cb5-49f0-91fc-c506ee83920d None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:53.089256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9eca6eb4-0cb5-49f0-91fc-c506ee83920d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:53.166366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:53.180628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 37/69] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:53.182760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a459a4-0069-4579-8171-c000706127f3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.183203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a459a4-0069-4579-8171-c000706127f3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.184132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a459a4-0069-4579-8171-c000706127f3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.185981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 38/70] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:53.195759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f91a8-637a-4f13-9ee4-3955193b1527 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.196041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f91a8-637a-4f13-9ee4-3955193b1527 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.196318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0f91a8-637a-4f13-9ee4-3955193b1527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.229798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7651225c-c0e7-41a0-a624-2dedb496a90f None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:53.232101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1a0f91a8-637a-4f13-9ee4-3955193b1527 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:53.233329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1a0f91a8-637a-4f13-9ee4-3955193b1527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:53.236642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:53.291204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77072212-a677-4dcd-b403-233ac24eefe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:53.291875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77072212-a677-4dcd-b403-233ac24eefe1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.292596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77072212-a677-4dcd-b403-233ac24eefe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.293039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77072212-a677-4dcd-b403-233ac24eefe1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.305379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77072212-a677-4dcd-b403-233ac24eefe1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-77072212-a677-4dcd-b403-233ac24eefe1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:53.310490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:53.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:51:53.312145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 33/71] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:51:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:51:53.312767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77072212-a677-4dcd-b403-233ac24eefe1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:53.347807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 39/72] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:53.348969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f91a8-637a-4f13-9ee4-3955193b1527 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:53.445848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77072212-a677-4dcd-b403-233ac24eefe1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:53.468347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0f91a8-637a-4f13-9ee4-3955193b1527 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:53.481326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0c180-ff46-4882-8a10-e3c08b70a9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:53.481970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0c180-ff46-4882-8a10-e3c08b70a9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.482346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0c180-ff46-4882-8a10-e3c08b70a9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.482623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f0c180-ff46-4882-8a10-e3c08b70a9c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.493985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f0c180-ff46-4882-8a10-e3c08b70a9c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:53.496934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-18f0c180-ff46-4882-8a10-e3c08b70a9c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:53.500090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:53.501197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:51:53.502023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 34/73] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:51:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:51:53.502638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0c180-ff46-4882-8a10-e3c08b70a9c8 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:53.515931 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3268-662d-4564-9bb7-945c0c85bb15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:53.516623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3268-662d-4564-9bb7-945c0c85bb15 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.516922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3268-662d-4564-9bb7-945c0c85bb15 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.517199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7d3268-662d-4564-9bb7-945c0c85bb15 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.517895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d3268-662d-4564-9bb7-945c0c85bb15 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:53.518185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d3268-662d-4564-9bb7-945c0c85bb15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:53.519717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7d3268-662d-4564-9bb7-945c0c85bb15 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:53.533616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 40/74] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:51:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:53.533616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3268-662d-4564-9bb7-945c0c85bb15 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:53.535116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:53.627116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f0c180-ff46-4882-8a10-e3c08b70a9c8 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:53.640215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7d3268-662d-4564-9bb7-945c0c85bb15 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:53.663879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e139036-47d5-41f5-82cb-026805a03d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:53.664521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e139036-47d5-41f5-82cb-026805a03d25 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.664811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e139036-47d5-41f5-82cb-026805a03d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.665109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e139036-47d5-41f5-82cb-026805a03d25 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.675569 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e139036-47d5-41f5-82cb-026805a03d25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:53.676293 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475d500-fb08-4d71-8bd9-146b8292ea22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:53.676933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d500-fb08-4d71-8bd9-146b8292ea22 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.677216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d500-fb08-4d71-8bd9-146b8292ea22 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.677493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7475d500-fb08-4d71-8bd9-146b8292ea22 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.678642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475d500-fb08-4d71-8bd9-146b8292ea22 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:53.680210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7475d500-fb08-4d71-8bd9-146b8292ea22 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-0e139036-47d5-41f5-82cb-026805a03d25 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:53.680823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:53.681804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:51:53.682602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:51:53.683235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 41/75] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:51:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:53.684283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475d500-fb08-4d71-8bd9-146b8292ea22 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:53.684681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 35/76] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:51:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:51:53.685534 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e139036-47d5-41f5-82cb-026805a03d25 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:53.744225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:53.779436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:53.794119 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7475d500-fb08-4d71-8bd9-146b8292ea22 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:53.795464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e139036-47d5-41f5-82cb-026805a03d25 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:53.828279 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2feb93-a5d4-431a-bb27-bd50d99ea20d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:53.828671 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4d434-57fd-4cac-b1ee-d7ff3fb47f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:53.828889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2feb93-a5d4-431a-bb27-bd50d99ea20d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.829172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2feb93-a5d4-431a-bb27-bd50d99ea20d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.829302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d434-57fd-4cac-b1ee-d7ff3fb47f99 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.829447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2feb93-a5d4-431a-bb27-bd50d99ea20d None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.829581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d434-57fd-4cac-b1ee-d7ff3fb47f99 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.829851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d4d434-57fd-4cac-b1ee-d7ff3fb47f99 None admin] PATH_INFO: `/v3/users/6453843cc76c4736b0fd2c86281afa8e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.830121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2feb93-a5d4-431a-bb27-bd50d99ea20d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:53.830437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2feb93-a5d4-431a-bb27-bd50d99ea20d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:53.831865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2feb93-a5d4-431a-bb27-bd50d99ea20d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:53.840567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 42/77] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:51:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:53.841381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2feb93-a5d4-431a-bb27-bd50d99ea20d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:53.850792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4d434-57fd-4cac-b1ee-d7ff3fb47f99 None admin] RBAC: Authorizing `identity:get_user(user_id=6453843cc76c4736b0fd2c86281afa8e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:53.852405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d4d434-57fd-4cac-b1ee-d7ff3fb47f99 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:53.854200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 36/78] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:53 2022] GET /identity/v3/users/6453843cc76c4736b0fd2c86281afa8e => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:53.855712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4d434-57fd-4cac-b1ee-d7ff3fb47f99 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:53.945238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2feb93-a5d4-431a-bb27-bd50d99ea20d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:53.961787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:53.967452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d4d434-57fd-4cac-b1ee-d7ff3fb47f99 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:53.979324 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e217b-94d9-48a3-87cc-43d2780d8d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:53.979992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e217b-94d9-48a3-87cc-43d2780d8d62 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:53.980440 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e217b-94d9-48a3-87cc-43d2780d8d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:53.981153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e217b-94d9-48a3-87cc-43d2780d8d62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:53.991227 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e217b-94d9-48a3-87cc-43d2780d8d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6f7e217b-94d9-48a3-87cc-43d2780d8d62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:53.997137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:53.998091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:51:53.998874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 43/79] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:51:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:51:53.999498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e217b-94d9-48a3-87cc-43d2780d8d62 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:54.006919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be0b21-407e-45f9-a3fb-a24f39a2fefb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:54.007577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be0b21-407e-45f9-a3fb-a24f39a2fefb None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:54.007859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be0b21-407e-45f9-a3fb-a24f39a2fefb None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:54.008130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60be0b21-407e-45f9-a3fb-a24f39a2fefb None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:54.008782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be0b21-407e-45f9-a3fb-a24f39a2fefb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:54.010275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60be0b21-407e-45f9-a3fb-a24f39a2fefb None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:54.027901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:54.038966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 37/80] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:51:53 2022] POST /identity/v3/users => generated 289 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:51:54.039983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be0b21-407e-45f9-a3fb-a24f39a2fefb None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:54.122146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e217b-94d9-48a3-87cc-43d2780d8d62 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:54.162237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ccdd0-e7fd-4e35-8c0f-1a27523b105b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:54.162899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ccdd0-e7fd-4e35-8c0f-1a27523b105b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:54.163186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ccdd0-e7fd-4e35-8c0f-1a27523b105b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:54.163463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ccdd0-e7fd-4e35-8c0f-1a27523b105b None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:54.164146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ccdd0-e7fd-4e35-8c0f-1a27523b105b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:54.164515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ccdd0-e7fd-4e35-8c0f-1a27523b105b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:54.164759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60be0b21-407e-45f9-a3fb-a24f39a2fefb None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:54.166023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9ccdd0-e7fd-4e35-8c0f-1a27523b105b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:54.176001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 44/81] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:51:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:54.176880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ccdd0-e7fd-4e35-8c0f-1a27523b105b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:54.206257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25360e-2918-4ca0-86f1-f757bf886e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:54.206892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25360e-2918-4ca0-86f1-f757bf886e5e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:54.207176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25360e-2918-4ca0-86f1-f757bf886e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:54.207449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc25360e-2918-4ca0-86f1-f757bf886e5e None admin] PATH_INFO: `/v3/users/6f68b08e3d424c04b847f9123ed23bfd` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:54.208623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25360e-2918-4ca0-86f1-f757bf886e5e None admin] RBAC: Authorizing `identity:get_user(user_id=6f68b08e3d424c04b847f9123ed23bfd)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:54.210096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc25360e-2918-4ca0-86f1-f757bf886e5e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:54.213475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 38/82] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:54 2022] GET /identity/v3/users/6f68b08e3d424c04b847f9123ed23bfd => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:54.217474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25360e-2918-4ca0-86f1-f757bf886e5e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:54.228837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:54.297965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:54.298896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9ccdd0-e7fd-4e35-8c0f-1a27523b105b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:54.342644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc25360e-2918-4ca0-86f1-f757bf886e5e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:54.345449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3daf-449f-458e-85d0-5cea813feae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:54.346075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3daf-449f-458e-85d0-5cea813feae8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:54.346376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3daf-449f-458e-85d0-5cea813feae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:54.346634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce3daf-449f-458e-85d0-5cea813feae8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:54.384258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae873d10-5b5a-410f-9318-6870f85e134b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:54.384919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873d10-5b5a-410f-9318-6870f85e134b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:54.385200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873d10-5b5a-410f-9318-6870f85e134b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:54.385483 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae873d10-5b5a-410f-9318-6870f85e134b None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:54.386177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae873d10-5b5a-410f-9318-6870f85e134b None admin] RBAC: Adding query filter params (name=member) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:54.386630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae873d10-5b5a-410f-9318-6870f85e134b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:54.388194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae873d10-5b5a-410f-9318-6870f85e134b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:54.398370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 39/83] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:51:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:54.399436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae873d10-5b5a-410f-9318-6870f85e134b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:54.436878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3daf-449f-458e-85d0-5cea813feae8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:54.438414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce3daf-449f-458e-85d0-5cea813feae8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:54.483286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:54.507883 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae873d10-5b5a-410f-9318-6870f85e134b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:54.539351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:54.549357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b44bc-2244-4f0f-b70a-836809a0c054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:54.550007 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b44bc-2244-4f0f-b70a-836809a0c054 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:54.550287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b44bc-2244-4f0f-b70a-836809a0c054 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:54.550620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b44bc-2244-4f0f-b70a-836809a0c054 None admin] PATH_INFO: `/v3/users/6453843cc76c4736b0fd2c86281afa8e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:54.551966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b44bc-2244-4f0f-b70a-836809a0c054 None admin] RBAC: Authorizing `identity:get_user(user_id=6453843cc76c4736b0fd2c86281afa8e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:54.553442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b44bc-2244-4f0f-b70a-836809a0c054 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:54.555079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 40/84] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:54 2022] GET /identity/v3/users/6453843cc76c4736b0fd2c86281afa8e => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:54.555847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b44bc-2244-4f0f-b70a-836809a0c054 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:54.570667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 45/85] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:51:54.572461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3daf-449f-458e-85d0-5cea813feae8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:54.676387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b44bc-2244-4f0f-b70a-836809a0c054 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:54.696832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce3daf-449f-458e-85d0-5cea813feae8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:54.713848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4113a4-7c0f-470b-8be1-cddd8095bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:54.714893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4113a4-7c0f-470b-8be1-cddd8095bc2a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:54.715295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4113a4-7c0f-470b-8be1-cddd8095bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:54.715734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4113a4-7c0f-470b-8be1-cddd8095bc2a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:54.737044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e24ef-4f0c-4310-9b1a-9ac8b2eb50e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:54.737771 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e24ef-4f0c-4310-9b1a-9ac8b2eb50e1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:54.738156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e24ef-4f0c-4310-9b1a-9ac8b2eb50e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:54.738534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e24ef-4f0c-4310-9b1a-9ac8b2eb50e1 None admin] PATH_INFO: `/v3/users/6453843cc76c4736b0fd2c86281afa8e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:54.739890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e24ef-4f0c-4310-9b1a-9ac8b2eb50e1 None admin] RBAC: Authorizing `identity:get_user(user_id=6453843cc76c4736b0fd2c86281afa8e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:54.741640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7e24ef-4f0c-4310-9b1a-9ac8b2eb50e1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:54.743951 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 46/86] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:54 2022] GET /identity/v3/users/6453843cc76c4736b0fd2c86281afa8e => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:54.745057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e24ef-4f0c-4310-9b1a-9ac8b2eb50e1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:54.755722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:54.796292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:54.804321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4113a4-7c0f-470b-8be1-cddd8095bc2a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:54.805947 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4113a4-7c0f-470b-8be1-cddd8095bc2a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:54.866458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7e24ef-4f0c-4310-9b1a-9ac8b2eb50e1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:54.911016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d4876-665b-4d96-97b9-5b6eadfb265d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:54.911664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d4876-665b-4d96-97b9-5b6eadfb265d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:54.911976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d4876-665b-4d96-97b9-5b6eadfb265d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:54.912567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d4876-665b-4d96-97b9-5b6eadfb265d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:54.919827 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 41/87] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:51:54.921126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4113a4-7c0f-470b-8be1-cddd8095bc2a None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:55.004750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d4876-665b-4d96-97b9-5b6eadfb265d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:55.007242 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d4876-665b-4d96-97b9-5b6eadfb265d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:55.023196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:55.037219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:55.045421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4113a4-7c0f-470b-8be1-cddd8095bc2a None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:55.093394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f07fa8-bc7f-49f1-8c85-a807ac4d6910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:55.094945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f07fa8-bc7f-49f1-8c85-a807ac4d6910 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:55.095363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f07fa8-bc7f-49f1-8c85-a807ac4d6910 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:55.095905 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f07fa8-bc7f-49f1-8c85-a807ac4d6910 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:55.097562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f07fa8-bc7f-49f1-8c85-a807ac4d6910 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:55.099877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f07fa8-bc7f-49f1-8c85-a807ac4d6910 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:55.101842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 42/88] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:51:54 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:55.102447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f07fa8-bc7f-49f1-8c85-a807ac4d6910 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:55.140285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 47/89] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:51:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:51:55.145512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d4876-665b-4d96-97b9-5b6eadfb265d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:55.230530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f07fa8-bc7f-49f1-8c85-a807ac4d6910 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:55.258437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d4876-665b-4d96-97b9-5b6eadfb265d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:55.267511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:55.275144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c1417-27dd-45c3-ae4e-6aa4d63a4885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:55.275144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c1417-27dd-45c3-ae4e-6aa4d63a4885 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:55.275144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c1417-27dd-45c3-ae4e-6aa4d63a4885 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:55.275144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56c1417-27dd-45c3-ae4e-6aa4d63a4885 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:55.304006 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfb9aa-fd80-45cb-bed3-25eefcafc657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:55.305025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfb9aa-fd80-45cb-bed3-25eefcafc657 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:55.305375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfb9aa-fd80-45cb-bed3-25eefcafc657 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:55.305715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edfb9aa-fd80-45cb-bed3-25eefcafc657 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:55.306957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfb9aa-fd80-45cb-bed3-25eefcafc657 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:55.308979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edfb9aa-fd80-45cb-bed3-25eefcafc657 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:55.311398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 48/90] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:51:55 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:55.312610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfb9aa-fd80-45cb-bed3-25eefcafc657 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:55.318668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:55.369730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c1417-27dd-45c3-ae4e-6aa4d63a4885 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:55.371810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56c1417-27dd-45c3-ae4e-6aa4d63a4885 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:55.425768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edfb9aa-fd80-45cb-bed3-25eefcafc657 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:55.460262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec43725-9130-48ad-b766-57ae7d3a02c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:55.460901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec43725-9130-48ad-b766-57ae7d3a02c6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:55.461180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec43725-9130-48ad-b766-57ae7d3a02c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:55.461450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec43725-9130-48ad-b766-57ae7d3a02c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:55.462179 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec43725-9130-48ad-b766-57ae7d3a02c6 None admin] RBAC: Adding query filter params (role.id=fc85aab66ae3471dbebf6a8340dbd444, scope.project.id=e745821f0ace4177a3094a0f8a054926, user.id=6453843cc76c4736b0fd2c86281afa8e) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:55.462539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec43725-9130-48ad-b766-57ae7d3a02c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:55.464025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec43725-9130-48ad-b766-57ae7d3a02c6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:55.470148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 49/91] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:51:55 2022] GET /identity/v3/role_assignments?user.id=6453843cc76c4736b0fd2c86281afa8e&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:55.470714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec43725-9130-48ad-b766-57ae7d3a02c6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:55.488808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 43/92] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:51:55.489469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c1417-27dd-45c3-ae4e-6aa4d63a4885 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:55.519510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:55.563582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:55.593205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec43725-9130-48ad-b766-57ae7d3a02c6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:55.610942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56c1417-27dd-45c3-ae4e-6aa4d63a4885 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:55.629637 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0eaf-bc2c-41df-85eb-2c991b58bd1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:55.630472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0eaf-bc2c-41df-85eb-2c991b58bd1b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:55.630755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0eaf-bc2c-41df-85eb-2c991b58bd1b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:55.631066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40e0eaf-bc2c-41df-85eb-2c991b58bd1b None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:55.632349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e0eaf-bc2c-41df-85eb-2c991b58bd1b None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:55.633901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40e0eaf-bc2c-41df-85eb-2c991b58bd1b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:55.635671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 50/93] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:51:55 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:55.636629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0eaf-bc2c-41df-85eb-2c991b58bd1b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:55.655047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d130e-15fd-48d4-a57f-adaf1d8597ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:55.655683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d130e-15fd-48d4-a57f-adaf1d8597ce None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:55.656064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d130e-15fd-48d4-a57f-adaf1d8597ce None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:55.656344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552d130e-15fd-48d4-a57f-adaf1d8597ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:55.657095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d130e-15fd-48d4-a57f-adaf1d8597ce None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=e745821f0ace4177a3094a0f8a054926, user.id=6f68b08e3d424c04b847f9123ed23bfd) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:55.657409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d130e-15fd-48d4-a57f-adaf1d8597ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:55.659016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552d130e-15fd-48d4-a57f-adaf1d8597ce None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:55.665657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 44/94] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:51:55 2022] GET /identity/v3/role_assignments?user.id=6f68b08e3d424c04b847f9123ed23bfd&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=85a146946817410b9a3addcf041c5909 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:55.666412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d130e-15fd-48d4-a57f-adaf1d8597ce None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:55.787895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552d130e-15fd-48d4-a57f-adaf1d8597ce None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:55.818448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:55.831805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28c75c-33a7-4d53-a226-f934021d49d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:55.833931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28c75c-33a7-4d53-a226-f934021d49d5 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:55.834221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28c75c-33a7-4d53-a226-f934021d49d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:55.834501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f28c75c-33a7-4d53-a226-f934021d49d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:55.835298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28c75c-33a7-4d53-a226-f934021d49d5 None admin] RBAC: Adding query filter params (role.id=17053af642bb46de91cf75f9be9d458a, scope.project.id=e745821f0ace4177a3094a0f8a054926, user.id=6453843cc76c4736b0fd2c86281afa8e) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:55.835611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28c75c-33a7-4d53-a226-f934021d49d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:55.837147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f28c75c-33a7-4d53-a226-f934021d49d5 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:55.852158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 45/95] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:51:55 2022] GET /identity/v3/role_assignments?user.id=6453843cc76c4736b0fd2c86281afa8e&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=17053af642bb46de91cf75f9be9d458a => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:55.862594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40e0eaf-bc2c-41df-85eb-2c991b58bd1b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:55.871799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:55.904567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a1f7b-faac-4f38-b97c-9c1cc53db9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:55.905608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a1f7b-faac-4f38-b97c-9c1cc53db9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:55.906082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a1f7b-faac-4f38-b97c-9c1cc53db9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:55.906546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a1f7b-faac-4f38-b97c-9c1cc53db9d3 None admin] PATH_INFO: `/v3/projects/5d573d75aa51426abe84846e81d0dafe` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:55.908212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a1f7b-faac-4f38-b97c-9c1cc53db9d3 None admin] RBAC: Authorizing `identity:get_project(project_id=5d573d75aa51426abe84846e81d0dafe)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:55.910010 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a1f7b-faac-4f38-b97c-9c1cc53db9d3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:55.911943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 51/96] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:51:55 2022] GET /identity/v3/projects/5d573d75aa51426abe84846e81d0dafe => generated 312 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:55.918128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28c75c-33a7-4d53-a226-f934021d49d5 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:56.068076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f28c75c-33a7-4d53-a226-f934021d49d5 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:56.110421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa970240-b2b8-4a50-8be6-012b5a2e6e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:56.111086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa970240-b2b8-4a50-8be6-012b5a2e6e29 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:56.111371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa970240-b2b8-4a50-8be6-012b5a2e6e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:56.111650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa970240-b2b8-4a50-8be6-012b5a2e6e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:56.112410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa970240-b2b8-4a50-8be6-012b5a2e6e29 None admin] RBAC: Adding query filter params (role.id=fc85aab66ae3471dbebf6a8340dbd444, scope.project.id=5d573d75aa51426abe84846e81d0dafe, user.id=6453843cc76c4736b0fd2c86281afa8e) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:56.112723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa970240-b2b8-4a50-8be6-012b5a2e6e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:56.114281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa970240-b2b8-4a50-8be6-012b5a2e6e29 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:56.120663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 46/97] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:51:55 2022] GET /identity/v3/role_assignments?user.id=6453843cc76c4736b0fd2c86281afa8e&scope.project.id=5d573d75aa51426abe84846e81d0dafe&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:56.420581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34fbd0-b723-4eb1-ab1c-d1492cc36199 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:56.421237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34fbd0-b723-4eb1-ab1c-d1492cc36199 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:56.421708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc34fbd0-b723-4eb1-ab1c-d1492cc36199 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:56.423306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 52/98] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:56.429841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b121d-f899-4035-86e4-a96a516a47cd None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:56.430379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b121d-f899-4035-86e4-a96a516a47cd None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:56.430873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62b121d-f899-4035-86e4-a96a516a47cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:56.456158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-b62b121d-f899-4035-86e4-a96a516a47cd None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:56.457693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b62b121d-f899-4035-86e4-a96a516a47cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:56.522794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:56.543122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 47/99] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:56.555586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a25566-87c6-4d2c-9878-0f2127ba920f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:56.556183 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a25566-87c6-4d2c-9878-0f2127ba920f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:56.556650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a25566-87c6-4d2c-9878-0f2127ba920f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:56.558213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 53/100] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:56.563725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff413-b329-482c-b0d1-7e245470c56e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:56.564015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff413-b329-482c-b0d1-7e245470c56e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:56.564289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006ff413-b329-482c-b0d1-7e245470c56e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:56.588006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-006ff413-b329-482c-b0d1-7e245470c56e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:56.589206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-006ff413-b329-482c-b0d1-7e245470c56e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:56.687741 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 48/101] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:57.020303 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a25566-87c6-4d2c-9878-0f2127ba920f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:57.152295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a25566-87c6-4d2c-9878-0f2127ba920f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:57.196893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ea11b-6e49-44be-b079-563f4dae2841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:57.197953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea11b-6e49-44be-b079-563f4dae2841 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:57.198471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea11b-6e49-44be-b079-563f4dae2841 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:57.198988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ea11b-6e49-44be-b079-563f4dae2841 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:57.200800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ea11b-6e49-44be-b079-563f4dae2841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:57.202466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ea11b-6e49-44be-b079-563f4dae2841 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:57.204357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 54/102] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:51:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:57.210058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ff413-b329-482c-b0d1-7e245470c56e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:57.212045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ea11b-6e49-44be-b079-563f4dae2841 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:57.267270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:57.356868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ea11b-6e49-44be-b079-563f4dae2841 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:57.409894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006ff413-b329-482c-b0d1-7e245470c56e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:57.411864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f0b4e-fe6e-497a-ba1c-ea2511957097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:57.412863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f0b4e-fe6e-497a-ba1c-ea2511957097 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:57.413338 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f0b4e-fe6e-497a-ba1c-ea2511957097 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:57.413800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7f0b4e-fe6e-497a-ba1c-ea2511957097 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:57.435877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7f0b4e-fe6e-497a-ba1c-ea2511957097 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-cc7f0b4e-fe6e-497a-ba1c-ea2511957097 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:57.442003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:57.442975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:51:57.443730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:51:57.446397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:57.447169 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 55/103] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:51:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:51:57.453048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f0b4e-fe6e-497a-ba1c-ea2511957097 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:57.496459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861276-995b-4ccb-93eb-6732ca0f2a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:57.497225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861276-995b-4ccb-93eb-6732ca0f2a5c None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:57.497515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861276-995b-4ccb-93eb-6732ca0f2a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:57.497790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1861276-995b-4ccb-93eb-6732ca0f2a5c None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:57.498478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1861276-995b-4ccb-93eb-6732ca0f2a5c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:57.500026 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1861276-995b-4ccb-93eb-6732ca0f2a5c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:57.556137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 49/104] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:51:57 2022] POST /identity/v3/projects => generated 302 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:51:57.638041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7f0b4e-fe6e-497a-ba1c-ea2511957097 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:57.639669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:57.688382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ac862-c62a-4fc1-bc53-84d6df0055f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:57.689022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac862-c62a-4fc1-bc53-84d6df0055f5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:57.689301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac862-c62a-4fc1-bc53-84d6df0055f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:57.689576 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9ac862-c62a-4fc1-bc53-84d6df0055f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:57.690268 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ac862-c62a-4fc1-bc53-84d6df0055f5 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:57.690574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ac862-c62a-4fc1-bc53-84d6df0055f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:57.692051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f9ac862-c62a-4fc1-bc53-84d6df0055f5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:57.706932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 56/105] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:51:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:57.712737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861276-995b-4ccb-93eb-6732ca0f2a5c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:57.877499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1861276-995b-4ccb-93eb-6732ca0f2a5c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:57.922416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a3339-af5f-4346-914e-d1ce976e2f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:57.923023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a3339-af5f-4346-914e-d1ce976e2f87 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:57.923307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a3339-af5f-4346-914e-d1ce976e2f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:57.923582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7a3339-af5f-4346-914e-d1ce976e2f87 None admin] PATH_INFO: `/v3/users/3211f700bfdb4f0f86e422cf21fdbaaa` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:57.943509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a3339-af5f-4346-914e-d1ce976e2f87 None admin] RBAC: Authorizing `identity:get_user(user_id=3211f700bfdb4f0f86e422cf21fdbaaa)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:57.945026 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7a3339-af5f-4346-914e-d1ce976e2f87 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:57.946797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 50/106] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:57 2022] GET /identity/v3/users/3211f700bfdb4f0f86e422cf21fdbaaa => generated 289 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:57.952942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ac862-c62a-4fc1-bc53-84d6df0055f5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:58.104310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9ac862-c62a-4fc1-bc53-84d6df0055f5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:58.147788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eb7ed-88cc-4b0c-94be-40b71dce873d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:58.148403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eb7ed-88cc-4b0c-94be-40b71dce873d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:58.148678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eb7ed-88cc-4b0c-94be-40b71dce873d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:58.148948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61eb7ed-88cc-4b0c-94be-40b71dce873d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:58.182483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:58.233743 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61eb7ed-88cc-4b0c-94be-40b71dce873d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:58.235430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61eb7ed-88cc-4b0c-94be-40b71dce873d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:58.337254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 57/107] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:51:58.343887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a3339-af5f-4346-914e-d1ce976e2f87 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:58.394562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:58.488783 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7a3339-af5f-4346-914e-d1ce976e2f87 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:58.529519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceab82c5-c873-4805-9e4d-c572259146c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:58.530187 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab82c5-c873-4805-9e4d-c572259146c8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:58.530471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab82c5-c873-4805-9e4d-c572259146c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:58.530748 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceab82c5-c873-4805-9e4d-c572259146c8 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:58.531939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab82c5-c873-4805-9e4d-c572259146c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:58.533409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceab82c5-c873-4805-9e4d-c572259146c8 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:58.535114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 51/108] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:51:58 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:58.541061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eb7ed-88cc-4b0c-94be-40b71dce873d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:58.577866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3597b0-c901-400d-b65f-7617c0995aeb None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:58.578174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3597b0-c901-400d-b65f-7617c0995aeb None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:58.578423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3597b0-c901-400d-b65f-7617c0995aeb None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:58.579824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 52/109] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:58.585335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363da01-5823-49a6-9d14-215da2ff96f4 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:58.585614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363da01-5823-49a6-9d14-215da2ff96f4 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:58.585894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4363da01-5823-49a6-9d14-215da2ff96f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:58.607764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-4363da01-5823-49a6-9d14-215da2ff96f4 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:58.608964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4363da01-5823-49a6-9d14-215da2ff96f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:58.626402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:58.686841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 53/110] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:58.688372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61eb7ed-88cc-4b0c-94be-40b71dce873d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:58.688568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675899-74b3-4c01-aacf-e508433dad3b None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:58.688981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675899-74b3-4c01-aacf-e508433dad3b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:58.689414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b675899-74b3-4c01-aacf-e508433dad3b None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:58.692048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 54/111] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:58.704080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f251cd-36f0-4b6b-bc96-a077cefaf183 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:58.704566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f251cd-36f0-4b6b-bc96-a077cefaf183 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:58.705008 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f251cd-36f0-4b6b-bc96-a077cefaf183 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:58.707234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 55/112] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:51:58.708854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b226b-d762-4181-87da-cf263de7a68d None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:58.709657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b226b-d762-4181-87da-cf263de7a68d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:58.710234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86b226b-d762-4181-87da-cf263de7a68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:58.734923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-e86b226b-d762-4181-87da-cf263de7a68d None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:58.736455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e86b226b-d762-4181-87da-cf263de7a68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:58.763265 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:58.804205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1522600b-43c5-4437-a2e2-aa894dcbc201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:58.805025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522600b-43c5-4437-a2e2-aa894dcbc201 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:58.805425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522600b-43c5-4437-a2e2-aa894dcbc201 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:58.805772 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1522600b-43c5-4437-a2e2-aa894dcbc201 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:58.806641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522600b-43c5-4437-a2e2-aa894dcbc201 None admin] RBAC: Adding query filter params (role.id=4afb6e1cde9747919b7e855da11806b0, scope.project.id=e745821f0ace4177a3094a0f8a054926, user.id=3211f700bfdb4f0f86e422cf21fdbaaa) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:58.807037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522600b-43c5-4437-a2e2-aa894dcbc201 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:58.808972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1522600b-43c5-4437-a2e2-aa894dcbc201 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:58.820871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 58/113] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:51:58 2022] GET /identity/v3/role_assignments?user.id=3211f700bfdb4f0f86e422cf21fdbaaa&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=4afb6e1cde9747919b7e855da11806b0 => generated 259 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:58.826894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 56/114] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:58.828176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c8d06-a55d-43c3-b4d1-a77c199cbbf2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:58.828609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c8d06-a55d-43c3-b4d1-a77c199cbbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:58.829021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439c8d06-a55d-43c3-b4d1-a77c199cbbf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:58.856275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-439c8d06-a55d-43c3-b4d1-a77c199cbbf2 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:58.857888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-439c8d06-a55d-43c3-b4d1-a77c199cbbf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:58.968456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 59/115] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:59.067637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b226b-d762-4181-87da-cf263de7a68d None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:59.167251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c8d06-a55d-43c3-b4d1-a77c199cbbf2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:59.193378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86b226b-d762-4181-87da-cf263de7a68d None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:59.233063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d0328-3116-4d42-b09c-78e6404684cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:59.234074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0328-3116-4d42-b09c-78e6404684cb None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:59.234540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0328-3116-4d42-b09c-78e6404684cb None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:59.235050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d0328-3116-4d42-b09c-78e6404684cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:59.268982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d0328-3116-4d42-b09c-78e6404684cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-a28d0328-3116-4d42-b09c-78e6404684cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:59.276546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:59.277509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:51:59.278260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:51:59.283566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 57/116] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:51:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:51:59.291973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d0328-3116-4d42-b09c-78e6404684cb None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:59.301593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:59.327265 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:59.364468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439c8d06-a55d-43c3-b4d1-a77c199cbbf2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:59.407225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9d8a9-06a1-4be5-a1cf-4830a232efc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:59.408222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9d8a9-06a1-4be5-a1cf-4830a232efc9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:59.408692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9d8a9-06a1-4be5-a1cf-4830a232efc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:59.409180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b9d8a9-06a1-4be5-a1cf-4830a232efc9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:59.429168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b9d8a9-06a1-4be5-a1cf-4830a232efc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b7b9d8a9-06a1-4be5-a1cf-4830a232efc9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:59.436857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:59.440323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:51:59.442269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 60/117] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:51:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:51:59.444688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9d8a9-06a1-4be5-a1cf-4830a232efc9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:59.508127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d0328-3116-4d42-b09c-78e6404684cb None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:59.543601 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38204348-8378-4bfa-9c59-c9eed04776e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:59.544554 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204348-8378-4bfa-9c59-c9eed04776e7 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:59.544775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204348-8378-4bfa-9c59-c9eed04776e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:59.545051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38204348-8378-4bfa-9c59-c9eed04776e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:59.545726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38204348-8378-4bfa-9c59-c9eed04776e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:59.546082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38204348-8378-4bfa-9c59-c9eed04776e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:59.547617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38204348-8378-4bfa-9c59-c9eed04776e7 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:59.556291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 58/118] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:51:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:59.557119 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38204348-8378-4bfa-9c59-c9eed04776e7 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:59.564728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b9d8a9-06a1-4be5-a1cf-4830a232efc9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:59.591239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:59.604621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c677f7-64fd-4f41-ad00-dd9ea0863639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:59.605927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c677f7-64fd-4f41-ad00-dd9ea0863639 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:59.606403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c677f7-64fd-4f41-ad00-dd9ea0863639 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:59.606937 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c677f7-64fd-4f41-ad00-dd9ea0863639 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:59.618325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c677f7-64fd-4f41-ad00-dd9ea0863639 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d6c677f7-64fd-4f41-ad00-dd9ea0863639 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:51:59.623582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:51:59.624441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:51:59.625182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:51:59.627452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 61/119] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:51:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:51:59.629700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85533-9904-401f-a597-dd14fcfa47fc None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:59.630185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85533-9904-401f-a597-dd14fcfa47fc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:59.630651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d85533-9904-401f-a597-dd14fcfa47fc None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:59.632132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 62/120] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:51:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:51:59.633253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85533-9904-401f-a597-dd14fcfa47fc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:59.647163 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:59.669653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38204348-8378-4bfa-9c59-c9eed04776e7 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:59.708233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d95d9c-99f5-4216-8663-c150e1158a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:59.709824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d95d9c-99f5-4216-8663-c150e1158a01 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:59.710589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d95d9c-99f5-4216-8663-c150e1158a01 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:59.711105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d95d9c-99f5-4216-8663-c150e1158a01 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:59.712223 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d95d9c-99f5-4216-8663-c150e1158a01 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:59.713568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d95d9c-99f5-4216-8663-c150e1158a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:59.715582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d95d9c-99f5-4216-8663-c150e1158a01 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:59.727266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 59/121] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:51:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:59.729107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9cfab-6072-4bb5-860c-b84d8d2c9234 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:59.729973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9cfab-6072-4bb5-860c-b84d8d2c9234 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:59.730698 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9cfab-6072-4bb5-860c-b84d8d2c9234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:59.747070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d85533-9904-401f-a597-dd14fcfa47fc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:59.755198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-c9b9cfab-6072-4bb5-860c-b84d8d2c9234 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:51:59.757248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c9b9cfab-6072-4bb5-860c-b84d8d2c9234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:51:59.795473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8abdd-943c-45c3-8919-056f3db03ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:59.796125 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8abdd-943c-45c3-8919-056f3db03ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:59.796401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8abdd-943c-45c3-8919-056f3db03ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:59.796672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa8abdd-943c-45c3-8919-056f3db03ec8 None admin] PATH_INFO: `/v3/users/6f68b08e3d424c04b847f9123ed23bfd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:59.797906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8abdd-943c-45c3-8919-056f3db03ec8 None admin] RBAC: Authorizing `identity:get_user(user_id=6f68b08e3d424c04b847f9123ed23bfd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:59.799498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa8abdd-943c-45c3-8919-056f3db03ec8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:59.801165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 63/122] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:59 2022] GET /identity/v3/users/6f68b08e3d424c04b847f9123ed23bfd => generated 247 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:59.801929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8abdd-943c-45c3-8919-056f3db03ec8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:59.839040 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 60/123] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:51:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:51:59.840415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9cfab-6072-4bb5-860c-b84d8d2c9234 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:59.852988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:59.909556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:51:59.913784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa8abdd-943c-45c3-8919-056f3db03ec8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:59.945025 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9cfab-6072-4bb5-860c-b84d8d2c9234 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:51:59.952741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607fd2a-f5b1-49fa-bb36-90f9faf16be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:59.953669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607fd2a-f5b1-49fa-bb36-90f9faf16be9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:59.954135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607fd2a-f5b1-49fa-bb36-90f9faf16be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:59.954697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2607fd2a-f5b1-49fa-bb36-90f9faf16be9 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:59.955580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607fd2a-f5b1-49fa-bb36-90f9faf16be9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:51:59.956166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607fd2a-f5b1-49fa-bb36-90f9faf16be9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:59.957747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2607fd2a-f5b1-49fa-bb36-90f9faf16be9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:59.967678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 64/124] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:51:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:59.968860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607fd2a-f5b1-49fa-bb36-90f9faf16be9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:51:59.980703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ad1ab-163d-4c50-a20c-e7fc37ba65c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:51:59.981472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ad1ab-163d-4c50-a20c-e7fc37ba65c4 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:51:59.981796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ad1ab-163d-4c50-a20c-e7fc37ba65c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:51:59.982060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1ad1ab-163d-4c50-a20c-e7fc37ba65c4 None admin] PATH_INFO: `/v3/users/6453843cc76c4736b0fd2c86281afa8e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:51:59.983303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ad1ab-163d-4c50-a20c-e7fc37ba65c4 None admin] RBAC: Authorizing `identity:get_user(user_id=6453843cc76c4736b0fd2c86281afa8e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:51:59.984833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1ad1ab-163d-4c50-a20c-e7fc37ba65c4 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:51:59.986539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 61/125] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:59 2022] GET /identity/v3/users/6453843cc76c4736b0fd2c86281afa8e => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:51:59.987416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ad1ab-163d-4c50-a20c-e7fc37ba65c4 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:00.082617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2607fd2a-f5b1-49fa-bb36-90f9faf16be9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:00.091152 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1ad1ab-163d-4c50-a20c-e7fc37ba65c4 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:00.093467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:00.122831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba3eba-dc08-4030-8426-e96e7b2e78ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:00.124040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3eba-dc08-4030-8426-e96e7b2e78ca None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:00.124519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3eba-dc08-4030-8426-e96e7b2e78ca None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:00.124975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecba3eba-dc08-4030-8426-e96e7b2e78ca None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:00.126493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba3eba-dc08-4030-8426-e96e7b2e78ca None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:00.126881 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebd7d5-2cda-4695-8478-01e9b689a479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:00.127528 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebd7d5-2cda-4695-8478-01e9b689a479 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:00.127806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebd7d5-2cda-4695-8478-01e9b689a479 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:00.128080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bebd7d5-2cda-4695-8478-01e9b689a479 None admin] PATH_INFO: `/v3/users/6453843cc76c4736b0fd2c86281afa8e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:00.129005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecba3eba-dc08-4030-8426-e96e7b2e78ca None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:00.129208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebd7d5-2cda-4695-8478-01e9b689a479 None admin] RBAC: Authorizing `identity:get_user(user_id=6453843cc76c4736b0fd2c86281afa8e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:00.130647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bebd7d5-2cda-4695-8478-01e9b689a479 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:00.131585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 65/126] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:51:59 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:00.132264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 62/127] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:51:59 2022] GET /identity/v3/users/6453843cc76c4736b0fd2c86281afa8e => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:00.132751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba3eba-dc08-4030-8426-e96e7b2e78ca None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:00.137642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebd7d5-2cda-4695-8478-01e9b689a479 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:00.141487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:00.240889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bebd7d5-2cda-4695-8478-01e9b689a479 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:00.247147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecba3eba-dc08-4030-8426-e96e7b2e78ca None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:00.276046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139065c0-5b0c-4734-a371-a118cd8638b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:00.276743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139065c0-5b0c-4734-a371-a118cd8638b1 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:00.277125 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139065c0-5b0c-4734-a371-a118cd8638b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:00.277405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139065c0-5b0c-4734-a371-a118cd8638b1 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926/users/6f68b08e3d424c04b847f9123ed23bfd/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:00.279616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139065c0-5b0c-4734-a371-a118cd8638b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e745821f0ace4177a3094a0f8a054926, user_id=6f68b08e3d424c04b847f9123ed23bfd, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:00.281712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139065c0-5b0c-4734-a371-a118cd8638b1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:00.286312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc18804-3019-4e70-8352-791d30f6c0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:00.287112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc18804-3019-4e70-8352-791d30f6c0e8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:00.287273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc18804-3019-4e70-8352-791d30f6c0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:00.287541 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc18804-3019-4e70-8352-791d30f6c0e8 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:00.288711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc18804-3019-4e70-8352-791d30f6c0e8 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:00.290317 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc18804-3019-4e70-8352-791d30f6c0e8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:00.292413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 66/128] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:00 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:00.293557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc18804-3019-4e70-8352-791d30f6c0e8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:00.300031 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 63/129] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:00 2022] PUT /identity/v3/projects/e745821f0ace4177a3094a0f8a054926/users/6f68b08e3d424c04b847f9123ed23bfd/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:00.301345 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139065c0-5b0c-4734-a371-a118cd8638b1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:00.350101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:00.391244 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:00.425725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc18804-3019-4e70-8352-791d30f6c0e8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:00.453711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139065c0-5b0c-4734-a371-a118cd8638b1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:00.478878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b476880d-923a-4626-aab5-a3c4672fd959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:00.479769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476880d-923a-4626-aab5-a3c4672fd959 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:00.480331 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476880d-923a-4626-aab5-a3c4672fd959 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:00.480756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b476880d-923a-4626-aab5-a3c4672fd959 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:00.481942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476880d-923a-4626-aab5-a3c4672fd959 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:00.483523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b476880d-923a-4626-aab5-a3c4672fd959 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:00.485399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 67/130] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:00 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:00.486340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e9c33-4ba0-420d-bc85-48ff01087fb1 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:00.486621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e9c33-4ba0-420d-bc85-48ff01087fb1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:00.486924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09e9c33-4ba0-420d-bc85-48ff01087fb1 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:00.488118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 68/131] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:00.488795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e9c33-4ba0-420d-bc85-48ff01087fb1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:00.504816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326d0d0-c1ab-417d-975a-23cc84be06df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:00.505781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326d0d0-c1ab-417d-975a-23cc84be06df None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:00.506324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326d0d0-c1ab-417d-975a-23cc84be06df None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:00.506604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7326d0d0-c1ab-417d-975a-23cc84be06df None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:00.519381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7326d0d0-c1ab-417d-975a-23cc84be06df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-7326d0d0-c1ab-417d-975a-23cc84be06df None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:00.527052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:00.527978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:00.528731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 64/132] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:00.529353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326d0d0-c1ab-417d-975a-23cc84be06df None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:00.612631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09e9c33-4ba0-420d-bc85-48ff01087fb1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:00.627336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:00.655132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20f93e-35f9-4be8-b232-7170f9cb7755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:00.655787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20f93e-35f9-4be8-b232-7170f9cb7755 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:00.656074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20f93e-35f9-4be8-b232-7170f9cb7755 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:00.656352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20f93e-35f9-4be8-b232-7170f9cb7755 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926/users/6453843cc76c4736b0fd2c86281afa8e/roles/17053af642bb46de91cf75f9be9d458a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:00.659311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20f93e-35f9-4be8-b232-7170f9cb7755 None admin] RBAC: Authorizing `identity:create_grant(project_id=e745821f0ace4177a3094a0f8a054926, user_id=6453843cc76c4736b0fd2c86281afa8e, role_id=17053af642bb46de91cf75f9be9d458a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:00.660952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20f93e-35f9-4be8-b232-7170f9cb7755 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:00.664803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7326d0d0-c1ab-417d-975a-23cc84be06df None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:00.683559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 69/133] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:00 2022] PUT /identity/v3/projects/e745821f0ace4177a3094a0f8a054926/users/6453843cc76c4736b0fd2c86281afa8e/roles/17053af642bb46de91cf75f9be9d458a => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:00.688143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b59de-d190-43c1-9f81-31c402aa3a97 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:00.688769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b59de-d190-43c1-9f81-31c402aa3a97 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:00.689222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9b59de-d190-43c1-9f81-31c402aa3a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:00.707624 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:00.727916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6c9b59de-d190-43c1-9f81-31c402aa3a97 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:00.731414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6c9b59de-d190-43c1-9f81-31c402aa3a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:00.733728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f99e21-3108-4325-a0ef-112d5ed031e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:00.734492 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f99e21-3108-4325-a0ef-112d5ed031e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:00.734792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f99e21-3108-4325-a0ef-112d5ed031e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:00.735116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f99e21-3108-4325-a0ef-112d5ed031e8 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926/users/6453843cc76c4736b0fd2c86281afa8e/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:00.738277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f99e21-3108-4325-a0ef-112d5ed031e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e745821f0ace4177a3094a0f8a054926, user_id=6453843cc76c4736b0fd2c86281afa8e, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:00.739878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f99e21-3108-4325-a0ef-112d5ed031e8 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:00.767084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 65/134] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:00 2022] PUT /identity/v3/projects/e745821f0ace4177a3094a0f8a054926/users/6453843cc76c4736b0fd2c86281afa8e/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:00.767084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f99e21-3108-4325-a0ef-112d5ed031e8 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:00.970632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 70/135] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:00.989157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f99e21-3108-4325-a0ef-112d5ed031e8 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:01.030298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44908bb-cb57-4ef5-bd19-44de5609fe7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:01.031002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44908bb-cb57-4ef5-bd19-44de5609fe7a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:01.031290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44908bb-cb57-4ef5-bd19-44de5609fe7a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:01.031572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44908bb-cb57-4ef5-bd19-44de5609fe7a None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:01.032303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44908bb-cb57-4ef5-bd19-44de5609fe7a None admin] RBAC: Adding query filter params (name=member) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:01.032612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44908bb-cb57-4ef5-bd19-44de5609fe7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:01.034098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44908bb-cb57-4ef5-bd19-44de5609fe7a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:01.043147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 66/136] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:01.049057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b59de-d190-43c1-9f81-31c402aa3a97 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:01.160997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9b59de-d190-43c1-9f81-31c402aa3a97 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:01.162579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:01.199599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe336c-763c-4285-8889-f6f202a44f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:01.200257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe336c-763c-4285-8889-f6f202a44f72 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:01.200542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe336c-763c-4285-8889-f6f202a44f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:01.200823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bbe336c-763c-4285-8889-f6f202a44f72 None admin] PATH_INFO: `/v3/users/6453843cc76c4736b0fd2c86281afa8e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:01.202007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe336c-763c-4285-8889-f6f202a44f72 None admin] RBAC: Authorizing `identity:get_user(user_id=6453843cc76c4736b0fd2c86281afa8e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:01.203557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bbe336c-763c-4285-8889-f6f202a44f72 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:01.205343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 71/137] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:01 2022] GET /identity/v3/users/6453843cc76c4736b0fd2c86281afa8e => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:01.210783 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44908bb-cb57-4ef5-bd19-44de5609fe7a None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:01.272282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:01.334381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe336c-763c-4285-8889-f6f202a44f72 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:01.356567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44908bb-cb57-4ef5-bd19-44de5609fe7a None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:01.428705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc8760-0f3d-4234-aff2-c8f4d08027e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:01.429369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc8760-0f3d-4234-aff2-c8f4d08027e9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:01.429651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc8760-0f3d-4234-aff2-c8f4d08027e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:01.429926 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfc8760-0f3d-4234-aff2-c8f4d08027e9 None admin] PATH_INFO: `/v3/projects/5d573d75aa51426abe84846e81d0dafe` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:01.434030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc8760-0f3d-4234-aff2-c8f4d08027e9 None admin] RBAC: Authorizing `identity:get_project(project_id=5d573d75aa51426abe84846e81d0dafe)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:01.435537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfc8760-0f3d-4234-aff2-c8f4d08027e9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:01.437226 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 67/138] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:01 2022] GET /identity/v3/projects/5d573d75aa51426abe84846e81d0dafe => generated 312 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:01.443017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc8760-0f3d-4234-aff2-c8f4d08027e9 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:01.502466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bbe336c-763c-4285-8889-f6f202a44f72 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:01.542672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba88672a-4cf4-4b8f-a2e3-34a76abbbd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:01.543196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88672a-4cf4-4b8f-a2e3-34a76abbbd64 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:01.543482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88672a-4cf4-4b8f-a2e3-34a76abbbd64 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:01.543820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba88672a-4cf4-4b8f-a2e3-34a76abbbd64 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:01.545076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88672a-4cf4-4b8f-a2e3-34a76abbbd64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:01.546562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba88672a-4cf4-4b8f-a2e3-34a76abbbd64 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:01.551291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 72/139] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:01.551291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5187a-9744-490e-8667-9c954dc58272 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:01.551291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5187a-9744-490e-8667-9c954dc58272 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:01.551291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5187a-9744-490e-8667-9c954dc58272 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:01.551291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 73/140] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:01.558187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6d22-47ed-4012-aaff-7e637a54b1a1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:01.558187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6d22-47ed-4012-aaff-7e637a54b1a1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:01.558906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fe6d22-47ed-4012-aaff-7e637a54b1a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:01.568649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfc8760-0f3d-4234-aff2-c8f4d08027e9 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:01.577691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d0fe6d22-47ed-4012-aaff-7e637a54b1a1 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:01.578738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d0fe6d22-47ed-4012-aaff-7e637a54b1a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:01.606796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:01.614650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:01.642320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dc412-5477-486f-9e38-3474634ed2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:01.643095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dc412-5477-486f-9e38-3474634ed2d4 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:01.643378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dc412-5477-486f-9e38-3474634ed2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:01.643660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51dc412-5477-486f-9e38-3474634ed2d4 None admin] PATH_INFO: `/v3/projects/5d573d75aa51426abe84846e81d0dafe/users/6453843cc76c4736b0fd2c86281afa8e/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:01.650442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dc412-5477-486f-9e38-3474634ed2d4 None admin] RBAC: Authorizing `identity:create_grant(project_id=5d573d75aa51426abe84846e81d0dafe, user_id=6453843cc76c4736b0fd2c86281afa8e, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:01.652051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51dc412-5477-486f-9e38-3474634ed2d4 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:01.655709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 74/141] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:01.656576 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe6d22-47ed-4012-aaff-7e637a54b1a1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:01.691313 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 68/142] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:01 2022] PUT /identity/v3/projects/5d573d75aa51426abe84846e81d0dafe/users/6453843cc76c4736b0fd2c86281afa8e/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:01.845940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fe6d22-47ed-4012-aaff-7e637a54b1a1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:01.887766 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4d02e-a168-42f8-9dbf-0b270fdebde3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:01.888397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4d02e-a168-42f8-9dbf-0b270fdebde3 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:01.888676 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4d02e-a168-42f8-9dbf-0b270fdebde3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:01.888948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb4d02e-a168-42f8-9dbf-0b270fdebde3 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:01.889604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4d02e-a168-42f8-9dbf-0b270fdebde3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:01.891111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb4d02e-a168-42f8-9dbf-0b270fdebde3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:01.930501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 75/143] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:01 2022] POST /identity/v3/users => generated 283 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:02.010929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dc412-5477-486f-9e38-3474634ed2d4 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:02.131368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51dc412-5477-486f-9e38-3474634ed2d4 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:02.174503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe767-85d2-4faf-952e-01aa76d5f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:02.175208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe767-85d2-4faf-952e-01aa76d5f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:02.175496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe767-85d2-4faf-952e-01aa76d5f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:02.175775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417fe767-85d2-4faf-952e-01aa76d5f7a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:02.194989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417fe767-85d2-4faf-952e-01aa76d5f7a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-417fe767-85d2-4faf-952e-01aa76d5f7a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:02.200385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:02.201246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:02.202385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 69/144] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:02.207569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4d02e-a168-42f8-9dbf-0b270fdebde3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:02.255845 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:02.353618 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb4d02e-a168-42f8-9dbf-0b270fdebde3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:02.399170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd736c3-5c89-418c-acc7-c2928766e258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:02.399705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd736c3-5c89-418c-acc7-c2928766e258 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:02.399982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd736c3-5c89-418c-acc7-c2928766e258 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:02.400256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd736c3-5c89-418c-acc7-c2928766e258 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:02.400948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd736c3-5c89-418c-acc7-c2928766e258 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:02.401255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd736c3-5c89-418c-acc7-c2928766e258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:02.402824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd736c3-5c89-418c-acc7-c2928766e258 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:02.414571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 76/145] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:02.420687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe767-85d2-4faf-952e-01aa76d5f7a8 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:02.476792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:02.594901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417fe767-85d2-4faf-952e-01aa76d5f7a8 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:02.645220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a42487-96da-44a1-8650-cafa7fd8fe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:02.645870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a42487-96da-44a1-8650-cafa7fd8fe4b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:02.646500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a42487-96da-44a1-8650-cafa7fd8fe4b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:02.646794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a42487-96da-44a1-8650-cafa7fd8fe4b None admin] PATH_INFO: `/v3/users/3211f700bfdb4f0f86e422cf21fdbaaa` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:02.649876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a42487-96da-44a1-8650-cafa7fd8fe4b None admin] RBAC: Authorizing `identity:get_user(user_id=3211f700bfdb4f0f86e422cf21fdbaaa)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:02.651394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a42487-96da-44a1-8650-cafa7fd8fe4b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:02.653248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 70/146] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:02 2022] GET /identity/v3/users/3211f700bfdb4f0f86e422cf21fdbaaa => generated 289 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:02.658969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd736c3-5c89-418c-acc7-c2928766e258 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:02.753886 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:02.769402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd736c3-5c89-418c-acc7-c2928766e258 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:02.805407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5854ebc-2a04-4894-814b-9a632a13e1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:02.806191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5854ebc-2a04-4894-814b-9a632a13e1eb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:02.806558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5854ebc-2a04-4894-814b-9a632a13e1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:02.806872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5854ebc-2a04-4894-814b-9a632a13e1eb None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:02.808087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5854ebc-2a04-4894-814b-9a632a13e1eb None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:02.810004 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5854ebc-2a04-4894-814b-9a632a13e1eb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:02.811724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 77/147] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:02 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:02.817750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a42487-96da-44a1-8650-cafa7fd8fe4b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:02.829111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8995d2-622f-4df6-823a-d9b0b4ab3fa0 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:02.829414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8995d2-622f-4df6-823a-d9b0b4ab3fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:02.829670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8995d2-622f-4df6-823a-d9b0b4ab3fa0 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:02.831217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 78/148] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:02.838045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021392-858f-4d4e-ab58-a7e0648c788f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:02.838045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021392-858f-4d4e-ab58-a7e0648c788f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:02.838045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6021392-858f-4d4e-ab58-a7e0648c788f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:02.860440 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e6021392-858f-4d4e-ab58-a7e0648c788f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:02.862381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e6021392-858f-4d4e-ab58-a7e0648c788f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:02.939160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 79/149] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:02.963129 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a42487-96da-44a1-8650-cafa7fd8fe4b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:02.964868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:03.000559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edc8215-65f4-44f3-b1f1-493a3a6b6845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:03.001256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc8215-65f4-44f3-b1f1-493a3a6b6845 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:03.001536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc8215-65f4-44f3-b1f1-493a3a6b6845 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:03.001819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edc8215-65f4-44f3-b1f1-493a3a6b6845 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926/users/3211f700bfdb4f0f86e422cf21fdbaaa/roles/4afb6e1cde9747919b7e855da11806b0` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:03.005283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc8215-65f4-44f3-b1f1-493a3a6b6845 None admin] RBAC: Authorizing `identity:create_grant(project_id=e745821f0ace4177a3094a0f8a054926, user_id=3211f700bfdb4f0f86e422cf21fdbaaa, role_id=4afb6e1cde9747919b7e855da11806b0)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:03.006756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edc8215-65f4-44f3-b1f1-493a3a6b6845 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:03.038938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 71/150] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:02 2022] PUT /identity/v3/projects/e745821f0ace4177a3094a0f8a054926/users/3211f700bfdb4f0f86e422cf21fdbaaa/roles/4afb6e1cde9747919b7e855da11806b0 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:03.457659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021392-858f-4d4e-ab58-a7e0648c788f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:03.556369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:03.583030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6021392-858f-4d4e-ab58-a7e0648c788f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:03.612080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2648-3434-4bb1-9918-61a214922220 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:03.612599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2648-3434-4bb1-9918-61a214922220 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:03.612599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ac2648-3434-4bb1-9918-61a214922220 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:03.613945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 72/151] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:03.619402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd1420-39b7-4dc0-bdab-8d2a9cc67c8e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:03.619779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd1420-39b7-4dc0-bdab-8d2a9cc67c8e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:03.620051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fd1420-39b7-4dc0-bdab-8d2a9cc67c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:03.645822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d7b2-9c46-4172-826e-5e163480005b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:03.647220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d7b2-9c46-4172-826e-5e163480005b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:03.647516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d7b2-9c46-4172-826e-5e163480005b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:03.647813 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407d7b2-9c46-4172-826e-5e163480005b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:03.655978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-33fd1420-39b7-4dc0-bdab-8d2a9cc67c8e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:03.657234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-33fd1420-39b7-4dc0-bdab-8d2a9cc67c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:03.676344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407d7b2-9c46-4172-826e-5e163480005b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7407d7b2-9c46-4172-826e-5e163480005b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:03.681221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:03.682124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:03.682964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:03.687157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 80/152] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:03.688881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d7b2-9c46-4172-826e-5e163480005b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:03.796825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 73/153] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:03.803902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407d7b2-9c46-4172-826e-5e163480005b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:03.842168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a347-eaab-48e6-b82d-676ea2661b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:03.843072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a347-eaab-48e6-b82d-676ea2661b60 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:03.843505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a347-eaab-48e6-b82d-676ea2661b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:03.843915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae6a347-eaab-48e6-b82d-676ea2661b60 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:03.844723 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a347-eaab-48e6-b82d-676ea2661b60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:03.845164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a347-eaab-48e6-b82d-676ea2661b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:03.846703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae6a347-eaab-48e6-b82d-676ea2661b60 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:03.855990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 81/154] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:03.861717 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd1420-39b7-4dc0-bdab-8d2a9cc67c8e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:03.989490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:04.001137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fd1420-39b7-4dc0-bdab-8d2a9cc67c8e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:04.045161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a65183e-187f-4a27-8df1-164570b44315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:04.045727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65183e-187f-4a27-8df1-164570b44315 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:04.046009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65183e-187f-4a27-8df1-164570b44315 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:04.046278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a65183e-187f-4a27-8df1-164570b44315 None admin] PATH_INFO: `/v3/users/6f68b08e3d424c04b847f9123ed23bfd` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:04.047462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65183e-187f-4a27-8df1-164570b44315 None admin] RBAC: Authorizing `identity:get_user(user_id=6f68b08e3d424c04b847f9123ed23bfd)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:04.048900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a65183e-187f-4a27-8df1-164570b44315 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:04.050486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 74/155] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:03 2022] GET /identity/v3/users/6f68b08e3d424c04b847f9123ed23bfd => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:04.059909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a347-eaab-48e6-b82d-676ea2661b60 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:04.075395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:04.075570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b0b2-fe44-4873-b774-ae9876c82abd None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:04.075570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b0b2-fe44-4873-b774-ae9876c82abd None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:04.075570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae6b0b2-fe44-4873-b774-ae9876c82abd None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:04.075570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 75/156] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:04.092789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a116401-34fb-4ed6-9509-acaf58f1ee72 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:04.093104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a116401-34fb-4ed6-9509-acaf58f1ee72 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:04.093343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a116401-34fb-4ed6-9509-acaf58f1ee72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:04.120253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-3a116401-34fb-4ed6-9509-acaf58f1ee72 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:04.121672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3a116401-34fb-4ed6-9509-acaf58f1ee72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:04.250983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae6a347-eaab-48e6-b82d-676ea2661b60 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:04.258796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 76/157] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:04.326124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c2d9-b853-4dc7-ae0f-69365cf5b2b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:04.326714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c2d9-b853-4dc7-ae0f-69365cf5b2b5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:04.327018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c2d9-b853-4dc7-ae0f-69365cf5b2b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:04.327291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294c2d9-b853-4dc7-ae0f-69365cf5b2b5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:04.418511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294c2d9-b853-4dc7-ae0f-69365cf5b2b5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:04.420055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4294c2d9-b853-4dc7-ae0f-69365cf5b2b5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:04.433565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:04.503870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a116401-34fb-4ed6-9509-acaf58f1ee72 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:04.553969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 82/158] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:04.560071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c2d9-b853-4dc7-ae0f-69365cf5b2b5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:04.762581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:04.778507 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4294c2d9-b853-4dc7-ae0f-69365cf5b2b5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:04.779298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a116401-34fb-4ed6-9509-acaf58f1ee72 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:04.795512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:04.842003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2155923-8dd7-4e18-bd54-d27e3fb0ef9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:04.842670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2155923-8dd7-4e18-bd54-d27e3fb0ef9a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:04.842995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2155923-8dd7-4e18-bd54-d27e3fb0ef9a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:04.843297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2155923-8dd7-4e18-bd54-d27e3fb0ef9a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:04.847463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1d3fe-1db1-426e-b07d-4ebde02dd940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:04.848110 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1d3fe-1db1-426e-b07d-4ebde02dd940 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:04.848390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1d3fe-1db1-426e-b07d-4ebde02dd940 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:04.848661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c1d3fe-1db1-426e-b07d-4ebde02dd940 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:04.849880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1d3fe-1db1-426e-b07d-4ebde02dd940 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:04.851436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c1d3fe-1db1-426e-b07d-4ebde02dd940 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:04.853093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 83/159] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:04 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:04.869638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2155923-8dd7-4e18-bd54-d27e3fb0ef9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-f2155923-8dd7-4e18-bd54-d27e3fb0ef9a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:04.874599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:04.875562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:04.876321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:04.876952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1d3fe-1db1-426e-b07d-4ebde02dd940 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:04.877026 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 77/160] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:04.881368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2155923-8dd7-4e18-bd54-d27e3fb0ef9a None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:05.005498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c1d3fe-1db1-426e-b07d-4ebde02dd940 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:05.044108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774a050-34c9-4530-9883-8936e27aa430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:05.044635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774a050-34c9-4530-9883-8936e27aa430 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:05.044959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774a050-34c9-4530-9883-8936e27aa430 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:05.045233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e774a050-34c9-4530-9883-8936e27aa430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:05.045977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774a050-34c9-4530-9883-8936e27aa430 None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=e745821f0ace4177a3094a0f8a054926, user.id=6f68b08e3d424c04b847f9123ed23bfd) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:05.046277 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774a050-34c9-4530-9883-8936e27aa430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:05.047995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e774a050-34c9-4530-9883-8936e27aa430 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:05.054548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 84/161] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:04 2022] GET /identity/v3/role_assignments?user.id=6f68b08e3d424c04b847f9123ed23bfd&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=85a146946817410b9a3addcf041c5909 => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:05.055882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774a050-34c9-4530-9883-8936e27aa430 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:05.119288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:05.169687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e774a050-34c9-4530-9883-8936e27aa430 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:05.210971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0abd7-2aae-4023-8cd3-fe30febdd709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:05.211625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0abd7-2aae-4023-8cd3-fe30febdd709 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:05.211901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0abd7-2aae-4023-8cd3-fe30febdd709 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:05.212172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb0abd7-2aae-4023-8cd3-fe30febdd709 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:05.212881 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2155923-8dd7-4e18-bd54-d27e3fb0ef9a None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:05.226159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb0abd7-2aae-4023-8cd3-fe30febdd709 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-dbb0abd7-2aae-4023-8cd3-fe30febdd709 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:05.232683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:05.235171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:05.237061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 85/162] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:05.244078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0abd7-2aae-4023-8cd3-fe30febdd709 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:05.337563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969e33-5cd5-4957-8b1d-6b63713d6ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:05.338108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969e33-5cd5-4957-8b1d-6b63713d6ead None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:05.338379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969e33-5cd5-4957-8b1d-6b63713d6ead None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:05.338704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2969e33-5cd5-4957-8b1d-6b63713d6ead None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:05.339435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969e33-5cd5-4957-8b1d-6b63713d6ead None admin] RBAC: Adding query filter params (name=member) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:05.339987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969e33-5cd5-4957-8b1d-6b63713d6ead None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:05.341430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2969e33-5cd5-4957-8b1d-6b63713d6ead None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:05.350679 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 78/163] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 469 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:05.356329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969e33-5cd5-4957-8b1d-6b63713d6ead None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:05.367973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb0abd7-2aae-4023-8cd3-fe30febdd709 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:05.371088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:05.378885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:05.414625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb8ed2d-64e4-4134-b093-02dbdb48b255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:05.415634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8ed2d-64e4-4134-b093-02dbdb48b255 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:05.416122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8ed2d-64e4-4134-b093-02dbdb48b255 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:05.416610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb8ed2d-64e4-4134-b093-02dbdb48b255 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:05.417555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8ed2d-64e4-4134-b093-02dbdb48b255 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:05.418118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8ed2d-64e4-4134-b093-02dbdb48b255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:05.419839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb8ed2d-64e4-4134-b093-02dbdb48b255 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:05.433929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 86/164] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:05.436022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5d20-dfea-4a59-a95c-e8bfa6864a3f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:05.436640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5d20-dfea-4a59-a95c-e8bfa6864a3f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:05.437166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2d5d20-dfea-4a59-a95c-e8bfa6864a3f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:05.439114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 87/165] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:05.440126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5d20-dfea-4a59-a95c-e8bfa6864a3f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:05.481315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2969e33-5cd5-4957-8b1d-6b63713d6ead None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:05.528555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be98da4f-d0e9-4ccf-a5d1-a77bdb84985a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:05.529216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98da4f-d0e9-4ccf-a5d1-a77bdb84985a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:05.529483 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98da4f-d0e9-4ccf-a5d1-a77bdb84985a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:05.529778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be98da4f-d0e9-4ccf-a5d1-a77bdb84985a None admin] PATH_INFO: `/v3/users/6453843cc76c4736b0fd2c86281afa8e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:05.535452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98da4f-d0e9-4ccf-a5d1-a77bdb84985a None admin] RBAC: Authorizing `identity:get_user(user_id=6453843cc76c4736b0fd2c86281afa8e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:05.536940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be98da4f-d0e9-4ccf-a5d1-a77bdb84985a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:05.542858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 79/166] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:05 2022] GET /identity/v3/users/6453843cc76c4736b0fd2c86281afa8e => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:05.542858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a350688-d56e-4e3b-a490-3f9327bfd5c1 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:05.542858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a350688-d56e-4e3b-a490-3f9327bfd5c1 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:05.542858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a350688-d56e-4e3b-a490-3f9327bfd5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:05.571889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-9a350688-d56e-4e3b-a490-3f9327bfd5c1 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:05.572987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-9a350688-d56e-4e3b-a490-3f9327bfd5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:05.596669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2d5d20-dfea-4a59-a95c-e8bfa6864a3f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:05.653626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f702d8-e186-4512-a97c-ac8792a2ea79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:05.654843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f702d8-e186-4512-a97c-ac8792a2ea79 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:05.655330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f702d8-e186-4512-a97c-ac8792a2ea79 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:05.655847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f702d8-e186-4512-a97c-ac8792a2ea79 None admin] PATH_INFO: `/v3/users/6453843cc76c4736b0fd2c86281afa8e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:05.659641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f702d8-e186-4512-a97c-ac8792a2ea79 None admin] RBAC: Authorizing `identity:get_user(user_id=6453843cc76c4736b0fd2c86281afa8e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:05.661128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f702d8-e186-4512-a97c-ac8792a2ea79 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:05.663115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 88/167] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:05 2022] GET /identity/v3/users/6453843cc76c4736b0fd2c86281afa8e => generated 275 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:05.664047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f702d8-e186-4512-a97c-ac8792a2ea79 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:05.685116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 80/168] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:05.685979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a350688-d56e-4e3b-a490-3f9327bfd5c1 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:05.702494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:05.734426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:05.793176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a350688-d56e-4e3b-a490-3f9327bfd5c1 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:05.828836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ff09-a525-48d7-820b-4395268a9a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:05.829451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ff09-a525-48d7-820b-4395268a9a06 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:05.829723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ff09-a525-48d7-820b-4395268a9a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:05.829988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4424ff09-a525-48d7-820b-4395268a9a06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:05.869739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f702d8-e186-4512-a97c-ac8792a2ea79 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:05.898362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424ff09-a525-48d7-820b-4395268a9a06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:05.904025 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4424ff09-a525-48d7-820b-4395268a9a06 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:05.920613 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:05.932253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed25ca-9fe9-4db3-abd3-fb480107660a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:05.932878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed25ca-9fe9-4db3-abd3-fb480107660a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:05.933153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed25ca-9fe9-4db3-abd3-fb480107660a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:05.933482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed25ca-9fe9-4db3-abd3-fb480107660a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.043710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed25ca-9fe9-4db3-abd3-fb480107660a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:06.045319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed25ca-9fe9-4db3-abd3-fb480107660a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:06.094097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:06.137987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 81/169] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:06.143756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ff09-a525-48d7-820b-4395268a9a06 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:06.253361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 89/170] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:06.254560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed25ca-9fe9-4db3-abd3-fb480107660a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:06.333415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4424ff09-a525-48d7-820b-4395268a9a06 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:06.359174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:06.370072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141bbeb-4320-4c78-b6ce-9c2457abbbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:06.371973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141bbeb-4320-4c78-b6ce-9c2457abbbda None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.371973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141bbeb-4320-4c78-b6ce-9c2457abbbda None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.371973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141bbeb-4320-4c78-b6ce-9c2457abbbda None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.372938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141bbeb-4320-4c78-b6ce-9c2457abbbda None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:06.374585 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141bbeb-4320-4c78-b6ce-9c2457abbbda None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:06.376382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 82/171] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:06 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:06.377236 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141bbeb-4320-4c78-b6ce-9c2457abbbda None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:06.479688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141bbeb-4320-4c78-b6ce-9c2457abbbda None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:06.483514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed25ca-9fe9-4db3-abd3-fb480107660a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:06.515851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dca717-3998-4e84-afd8-82210eff0e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:06.516594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dca717-3998-4e84-afd8-82210eff0e85 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.516935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dca717-3998-4e84-afd8-82210eff0e85 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.517271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dca717-3998-4e84-afd8-82210eff0e85 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.518579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dca717-3998-4e84-afd8-82210eff0e85 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:06.520138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dca717-3998-4e84-afd8-82210eff0e85 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:06.522183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 83/172] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:06 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:06.523424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985696-ab4a-4626-a077-78562b47d0ae None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.523876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985696-ab4a-4626-a077-78562b47d0ae None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.524208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66985696-ab4a-4626-a077-78562b47d0ae None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.525657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 84/173] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:06.526218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985696-ab4a-4626-a077-78562b47d0ae None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:06.536978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:06.556821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebfe91-3dd2-4b58-826d-944b1d00d06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:06.557911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebfe91-3dd2-4b58-826d-944b1d00d06a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.558433 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebfe91-3dd2-4b58-826d-944b1d00d06a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.558952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebfe91-3dd2-4b58-826d-944b1d00d06a None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.580263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bebfe91-3dd2-4b58-826d-944b1d00d06a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:06.591251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-2bebfe91-3dd2-4b58-826d-944b1d00d06a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:06.593392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:06.594269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:06.595070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 90/174] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:06.596181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb92393-a94a-42e9-8f98-48b41e83d381 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.596338 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb92393-a94a-42e9-8f98-48b41e83d381 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.601030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb92393-a94a-42e9-8f98-48b41e83d381 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.636369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1cb92393-a94a-42e9-8f98-48b41e83d381 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:06.637687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1cb92393-a94a-42e9-8f98-48b41e83d381 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:06.644248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66985696-ab4a-4626-a077-78562b47d0ae None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:06.679917 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c7f16-9365-419e-87ea-2a64fc083018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:06.680642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c7f16-9365-419e-87ea-2a64fc083018 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.680916 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c7f16-9365-419e-87ea-2a64fc083018 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.681184 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58c7f16-9365-419e-87ea-2a64fc083018 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.681913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c7f16-9365-419e-87ea-2a64fc083018 None admin] RBAC: Adding query filter params (role.id=17053af642bb46de91cf75f9be9d458a, scope.project.id=e745821f0ace4177a3094a0f8a054926, user.id=6453843cc76c4736b0fd2c86281afa8e) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:06.682217 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c7f16-9365-419e-87ea-2a64fc083018 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:06.683848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58c7f16-9365-419e-87ea-2a64fc083018 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:06.690480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 85/175] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:06 2022] GET /identity/v3/role_assignments?user.id=6453843cc76c4736b0fd2c86281afa8e&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=17053af642bb46de91cf75f9be9d458a => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:06.691381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c7f16-9365-419e-87ea-2a64fc083018 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:06.792240 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 91/176] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:06.793799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb92393-a94a-42e9-8f98-48b41e83d381 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:06.869754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58c7f16-9365-419e-87ea-2a64fc083018 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:06.886895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:06.952130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7abc5cb-0e56-4c12-b794-db2e3567a408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:06.953275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abc5cb-0e56-4c12-b794-db2e3567a408 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.953754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abc5cb-0e56-4c12-b794-db2e3567a408 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.954292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7abc5cb-0e56-4c12-b794-db2e3567a408 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.955283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abc5cb-0e56-4c12-b794-db2e3567a408 None admin] RBAC: Adding query filter params (role.id=fc85aab66ae3471dbebf6a8340dbd444, scope.project.id=e745821f0ace4177a3094a0f8a054926, user.id=6453843cc76c4736b0fd2c86281afa8e) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:06.955806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abc5cb-0e56-4c12-b794-db2e3567a408 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:06.957677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7abc5cb-0e56-4c12-b794-db2e3567a408 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:06.973966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 86/177] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:06 2022] GET /identity/v3/role_assignments?user.id=6453843cc76c4736b0fd2c86281afa8e&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:06.975654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9faa2-c654-4195-90d3-0a29995a5668 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.976131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9faa2-c654-4195-90d3-0a29995a5668 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.976621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed9faa2-c654-4195-90d3-0a29995a5668 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.978083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 87/178] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:06.979525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947ada-23d6-4e8c-89b5-068a4ba19368 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.980014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947ada-23d6-4e8c-89b5-068a4ba19368 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.985715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e947ada-23d6-4e8c-89b5-068a4ba19368 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:06.987500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 88/179] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:06 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:06.988857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecda42-6986-4044-a553-4d07cc47c446 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:06.989398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecda42-6986-4044-a553-4d07cc47c446 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:06.989906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ecda42-6986-4044-a553-4d07cc47c446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.021527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d4ecda42-6986-4044-a553-4d07cc47c446 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:07.024580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d4ecda42-6986-4044-a553-4d07cc47c446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:07.048115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb92393-a94a-42e9-8f98-48b41e83d381 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:07.082862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:07.110799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a5f74f-51e6-4634-b287-c176baffc7ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:07.111776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5f74f-51e6-4634-b287-c176baffc7ac None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:07.112271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5f74f-51e6-4634-b287-c176baffc7ac None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:07.112730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a5f74f-51e6-4634-b287-c176baffc7ac None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.113619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5f74f-51e6-4634-b287-c176baffc7ac None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:07.114123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5f74f-51e6-4634-b287-c176baffc7ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:07.115770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a5f74f-51e6-4634-b287-c176baffc7ac None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:07.129437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 92/180] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:07.136783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c624e-edba-4aef-9f9c-5d98d28c4e00 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:07.137308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c624e-edba-4aef-9f9c-5d98d28c4e00 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:07.137757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568c624e-edba-4aef-9f9c-5d98d28c4e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.160017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-568c624e-edba-4aef-9f9c-5d98d28c4e00 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:07.161225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-568c624e-edba-4aef-9f9c-5d98d28c4e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:07.161975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 89/181] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:07.163086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecda42-6986-4044-a553-4d07cc47c446 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:07.262908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 93/182] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:07.264063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c624e-edba-4aef-9f9c-5d98d28c4e00 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:07.295164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ecda42-6986-4044-a553-4d07cc47c446 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:07.298899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:07.344743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3678274f-46b9-48a6-89a3-7266568ae075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:07.345736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678274f-46b9-48a6-89a3-7266568ae075 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:07.346194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678274f-46b9-48a6-89a3-7266568ae075 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:07.346645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3678274f-46b9-48a6-89a3-7266568ae075 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.359499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3678274f-46b9-48a6-89a3-7266568ae075 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-3678274f-46b9-48a6-89a3-7266568ae075 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:07.364865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:07.365736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:07.366523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:07.369814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 90/183] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:07.371456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194e12c-a6c7-44e1-8d64-9df8b19d3b2c None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:07.371945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194e12c-a6c7-44e1-8d64-9df8b19d3b2c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:07.372398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194e12c-a6c7-44e1-8d64-9df8b19d3b2c None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.373985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 91/184] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:07.378105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194e12c-a6c7-44e1-8d64-9df8b19d3b2c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:07.398561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568c624e-edba-4aef-9f9c-5d98d28c4e00 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:07.412335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:07.446946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be485d-84ed-42fe-a779-1503591a55a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:07.447729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be485d-84ed-42fe-a779-1503591a55a2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:07.448077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be485d-84ed-42fe-a779-1503591a55a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:07.448452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be485d-84ed-42fe-a779-1503591a55a2 None admin] PATH_INFO: `/v3/users/6453843cc76c4736b0fd2c86281afa8e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.449855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be485d-84ed-42fe-a779-1503591a55a2 None admin] RBAC: Authorizing `identity:get_user(user_id=6453843cc76c4736b0fd2c86281afa8e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:07.451668 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be485d-84ed-42fe-a779-1503591a55a2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:07.453372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 94/185] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:07 2022] GET /identity/v3/users/6453843cc76c4736b0fd2c86281afa8e => generated 275 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:07.455608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ca117-394f-4e70-8b5b-c43f82ba2386 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:07.455887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ca117-394f-4e70-8b5b-c43f82ba2386 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:07.456159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6ca117-394f-4e70-8b5b-c43f82ba2386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.476602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7c6ca117-394f-4e70-8b5b-c43f82ba2386 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:07.477843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7c6ca117-394f-4e70-8b5b-c43f82ba2386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:07.516275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194e12c-a6c7-44e1-8d64-9df8b19d3b2c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:07.556529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0f0d7-a35a-4dce-b60f-aa2328c3a55e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:07.557059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0f0d7-a35a-4dce-b60f-aa2328c3a55e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:07.557332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0f0d7-a35a-4dce-b60f-aa2328c3a55e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:07.566969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 95/186] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:07.567108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df0f0d7-a35a-4dce-b60f-aa2328c3a55e None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.567108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0f0d7-a35a-4dce-b60f-aa2328c3a55e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:07.567267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ca117-394f-4e70-8b5b-c43f82ba2386 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:07.567372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0f0d7-a35a-4dce-b60f-aa2328c3a55e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:07.567372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df0f0d7-a35a-4dce-b60f-aa2328c3a55e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:07.575256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 92/187] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:07.576002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0f0d7-a35a-4dce-b60f-aa2328c3a55e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:07.602728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:07.674840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df0f0d7-a35a-4dce-b60f-aa2328c3a55e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:07.681612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6ca117-394f-4e70-8b5b-c43f82ba2386 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:07.691289 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:07.710698 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e537b-e0a9-47de-b053-75ed043f1aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:07.711369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e537b-e0a9-47de-b053-75ed043f1aff None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:07.711645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e537b-e0a9-47de-b053-75ed043f1aff None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:07.711914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78e537b-e0a9-47de-b053-75ed043f1aff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.718520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237f44a-a4f4-4fd0-a037-cf009e357644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:07.719167 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237f44a-a4f4-4fd0-a037-cf009e357644 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:07.719443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237f44a-a4f4-4fd0-a037-cf009e357644 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:07.719714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7237f44a-a4f4-4fd0-a037-cf009e357644 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.722442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78e537b-e0a9-47de-b053-75ed043f1aff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-d78e537b-e0a9-47de-b053-75ed043f1aff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:07.727801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:07.728909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:07.729703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 93/188] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:07.730535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e537b-e0a9-47de-b053-75ed043f1aff None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:07.794663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237f44a-a4f4-4fd0-a037-cf009e357644 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:07.796173 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7237f44a-a4f4-4fd0-a037-cf009e357644 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:07.830478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:07.849195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78e537b-e0a9-47de-b053-75ed043f1aff None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:07.882393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1929702-2c89-4d5d-8706-e7591f500dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:07.883070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929702-2c89-4d5d-8706-e7591f500dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:07.883336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929702-2c89-4d5d-8706-e7591f500dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:07.883618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1929702-2c89-4d5d-8706-e7591f500dd9 None admin] PATH_INFO: `/v3/users/f6ae58b712d84ab4b7c45da21aca2d91` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:07.897039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1929702-2c89-4d5d-8706-e7591f500dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ae58b712d84ab4b7c45da21aca2d91)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:07.898591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1929702-2c89-4d5d-8706-e7591f500dd9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:07.904832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 94/189] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:07 2022] GET /identity/v3/users/f6ae58b712d84ab4b7c45da21aca2d91 => generated 283 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:07.905009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 96/190] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:07.905103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1929702-2c89-4d5d-8706-e7591f500dd9 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:07.905185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237f44a-a4f4-4fd0-a037-cf009e357644 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:07.913844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:08.001495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1929702-2c89-4d5d-8706-e7591f500dd9 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.002830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7237f44a-a4f4-4fd0-a037-cf009e357644 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.035388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a25f1a-8ca0-409b-8b35-6dd7824a0683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.036024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a25f1a-8ca0-409b-8b35-6dd7824a0683 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.036223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60984b-906c-43cd-9279-3da35d06ba57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.036328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a25f1a-8ca0-409b-8b35-6dd7824a0683 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.036549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a25f1a-8ca0-409b-8b35-6dd7824a0683 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.036829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60984b-906c-43cd-9279-3da35d06ba57 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.037109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60984b-906c-43cd-9279-3da35d06ba57 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.037379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de60984b-906c-43cd-9279-3da35d06ba57 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.038043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60984b-906c-43cd-9279-3da35d06ba57 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:08.038348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60984b-906c-43cd-9279-3da35d06ba57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.039785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de60984b-906c-43cd-9279-3da35d06ba57 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.047750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a25f1a-8ca0-409b-8b35-6dd7824a0683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:08.047887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 97/191] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:08.047887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60984b-906c-43cd-9279-3da35d06ba57 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-d1a25f1a-8ca0-409b-8b35-6dd7824a0683 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:08.052733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:08.053664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 95/192] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:08.054438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a25f1a-8ca0-409b-8b35-6dd7824a0683 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.058693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:08.123698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:08.158141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a25f1a-8ca0-409b-8b35-6dd7824a0683 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.158400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de60984b-906c-43cd-9279-3da35d06ba57 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.191820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efc96c-8263-446f-9606-cdf4026a989e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.192453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc96c-8263-446f-9606-cdf4026a989e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.192726 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc96c-8263-446f-9606-cdf4026a989e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.193017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5efc96c-8263-446f-9606-cdf4026a989e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.193628 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29401e7-0829-417b-861e-5eda34f0810e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.194136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efc96c-8263-446f-9606-cdf4026a989e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.194242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29401e7-0829-417b-861e-5eda34f0810e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.194508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29401e7-0829-417b-861e-5eda34f0810e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.194820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29401e7-0829-417b-861e-5eda34f0810e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.195649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5efc96c-8263-446f-9606-cdf4026a989e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.197204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 98/193] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:08.198032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efc96c-8263-446f-9606-cdf4026a989e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.266505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29401e7-0829-417b-861e-5eda34f0810e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.268126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29401e7-0829-417b-861e-5eda34f0810e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.271771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:08.299415 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5efc96c-8263-446f-9606-cdf4026a989e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.333021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555a552-0f5f-4e6a-9f7e-13ba1d3168df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.333653 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555a552-0f5f-4e6a-9f7e-13ba1d3168df None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.333952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555a552-0f5f-4e6a-9f7e-13ba1d3168df None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.334186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5555a552-0f5f-4e6a-9f7e-13ba1d3168df None admin] PATH_INFO: `/v3/projects/5d573d75aa51426abe84846e81d0dafe` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.335458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555a552-0f5f-4e6a-9f7e-13ba1d3168df None admin] RBAC: Authorizing `identity:get_project(project_id=5d573d75aa51426abe84846e81d0dafe)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.337040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5555a552-0f5f-4e6a-9f7e-13ba1d3168df None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.338666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 99/194] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:08 2022] GET /identity/v3/projects/5d573d75aa51426abe84846e81d0dafe => generated 312 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:08.339621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555a552-0f5f-4e6a-9f7e-13ba1d3168df None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.348585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:08.375231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 96/195] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:08.376314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29401e7-0829-417b-861e-5eda34f0810e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.443109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5555a552-0f5f-4e6a-9f7e-13ba1d3168df None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.475197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29401e7-0829-417b-861e-5eda34f0810e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.476663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f9a90-860c-489f-8e20-095a761630de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.477296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f9a90-860c-489f-8e20-095a761630de None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.477590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f9a90-860c-489f-8e20-095a761630de None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.477867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166f9a90-860c-489f-8e20-095a761630de None admin] PATH_INFO: `/v3/users/3211f700bfdb4f0f86e422cf21fdbaaa` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.478340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:08.479028 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f9a90-860c-489f-8e20-095a761630de None admin] RBAC: Authorizing `identity:get_user(user_id=3211f700bfdb4f0f86e422cf21fdbaaa)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.480487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166f9a90-860c-489f-8e20-095a761630de None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.482799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 100/196] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:08 2022] GET /identity/v3/users/3211f700bfdb4f0f86e422cf21fdbaaa => generated 289 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:08.482999 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f9a90-860c-489f-8e20-095a761630de None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.511740 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360796b-cda6-4a27-afe6-c804cc9369c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.512459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360796b-cda6-4a27-afe6-c804cc9369c4 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.512694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360796b-cda6-4a27-afe6-c804cc9369c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.513021 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1360796b-cda6-4a27-afe6-c804cc9369c4 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.513684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360796b-cda6-4a27-afe6-c804cc9369c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:08.513986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360796b-cda6-4a27-afe6-c804cc9369c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.515409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1360796b-cda6-4a27-afe6-c804cc9369c4 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.523960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 97/197] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:08.524748 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360796b-cda6-4a27-afe6-c804cc9369c4 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.558498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:08.583012 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166f9a90-860c-489f-8e20-095a761630de None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.616043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc93142-96e7-451b-ac74-19481ee57a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.616682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93142-96e7-451b-ac74-19481ee57a59 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.616944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93142-96e7-451b-ac74-19481ee57a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.617214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc93142-96e7-451b-ac74-19481ee57a59 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.617859 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc93142-96e7-451b-ac74-19481ee57a59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.619358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc93142-96e7-451b-ac74-19481ee57a59 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.623198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1360796b-cda6-4a27-afe6-c804cc9369c4 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.642886 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 101/198] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:08 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:08.643649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc93142-96e7-451b-ac74-19481ee57a59 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.663239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901a45e-5f1b-496b-ad79-56e9194993ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.663969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901a45e-5f1b-496b-ad79-56e9194993ad None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.664334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901a45e-5f1b-496b-ad79-56e9194993ad None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.664662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c901a45e-5f1b-496b-ad79-56e9194993ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.665414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901a45e-5f1b-496b-ad79-56e9194993ad None admin] RBAC: Adding query filter params (role.id=fc85aab66ae3471dbebf6a8340dbd444, scope.project.id=5d573d75aa51426abe84846e81d0dafe, user.id=6453843cc76c4736b0fd2c86281afa8e) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:08.665722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901a45e-5f1b-496b-ad79-56e9194993ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.667259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c901a45e-5f1b-496b-ad79-56e9194993ad None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.674384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 98/199] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:08 2022] GET /identity/v3/role_assignments?user.id=6453843cc76c4736b0fd2c86281afa8e&scope.project.id=5d573d75aa51426abe84846e81d0dafe&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:08.675102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901a45e-5f1b-496b-ad79-56e9194993ad None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.713113 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:08.812405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c901a45e-5f1b-496b-ad79-56e9194993ad None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.821241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc93142-96e7-451b-ac74-19481ee57a59 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:08.859137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:08.861155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ee307-6135-47b8-a592-c2b2df9df7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.863277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ee307-6135-47b8-a592-c2b2df9df7de None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.863277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ee307-6135-47b8-a592-c2b2df9df7de None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.863277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974ee307-6135-47b8-a592-c2b2df9df7de None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.868462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d98ed5-b24a-4707-98da-14ab7c416024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:08.869514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d98ed5-b24a-4707-98da-14ab7c416024 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:08.869621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d98ed5-b24a-4707-98da-14ab7c416024 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:08.870009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d98ed5-b24a-4707-98da-14ab7c416024 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:08.871627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d98ed5-b24a-4707-98da-14ab7c416024 None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.873520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d98ed5-b24a-4707-98da-14ab7c416024 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.875837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 102/200] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:08 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:08.876082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d98ed5-b24a-4707-98da-14ab7c416024 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:08.948547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ee307-6135-47b8-a592-c2b2df9df7de None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:08.950632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974ee307-6135-47b8-a592-c2b2df9df7de None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:08.989020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:09.010041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d98ed5-b24a-4707-98da-14ab7c416024 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:09.056265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124409e2-cab8-4281-999b-fc1edd1cadbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:09.056929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124409e2-cab8-4281-999b-fc1edd1cadbe None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:09.057259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124409e2-cab8-4281-999b-fc1edd1cadbe None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:09.057535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124409e2-cab8-4281-999b-fc1edd1cadbe None admin] PATH_INFO: `/v3/users/f6ae58b712d84ab4b7c45da21aca2d91` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:09.059000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124409e2-cab8-4281-999b-fc1edd1cadbe None admin] RBAC: Authorizing `identity:get_user(user_id=f6ae58b712d84ab4b7c45da21aca2d91)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:09.060523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124409e2-cab8-4281-999b-fc1edd1cadbe None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:09.062275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 103/201] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:08 2022] GET /identity/v3/users/f6ae58b712d84ab4b7c45da21aca2d91 => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:09.067742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124409e2-cab8-4281-999b-fc1edd1cadbe None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:09.072867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 99/202] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:09.074115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ee307-6135-47b8-a592-c2b2df9df7de None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:09.143038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:09.176886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974ee307-6135-47b8-a592-c2b2df9df7de None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:09.184328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124409e2-cab8-4281-999b-fc1edd1cadbe None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:09.215967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:09.225941 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087383d4-e5d4-4d96-b4f7-db32153834cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:09.226933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087383d4-e5d4-4d96-b4f7-db32153834cb None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:09.227401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087383d4-e5d4-4d96-b4f7-db32153834cb None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:09.227872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087383d4-e5d4-4d96-b4f7-db32153834cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:09.230134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aafc3-1e04-4db4-9c9a-1005668b7bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:09.230969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aafc3-1e04-4db4-9c9a-1005668b7bbd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:09.231249 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aafc3-1e04-4db4-9c9a-1005668b7bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:09.231523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90aafc3-1e04-4db4-9c9a-1005668b7bbd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:09.232484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90aafc3-1e04-4db4-9c9a-1005668b7bbd None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=1e153a5d02af48acaf1b20217342aed9, user.id=f6ae58b712d84ab4b7c45da21aca2d91) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:09.232796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90aafc3-1e04-4db4-9c9a-1005668b7bbd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:09.235215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90aafc3-1e04-4db4-9c9a-1005668b7bbd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:09.242041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 104/203] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:09 2022] GET /identity/v3/role_assignments?user.id=f6ae58b712d84ab4b7c45da21aca2d91&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=85a146946817410b9a3addcf041c5909 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:09.249418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aafc3-1e04-4db4-9c9a-1005668b7bbd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:09.377983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087383d4-e5d4-4d96-b4f7-db32153834cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:09.386696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90aafc3-1e04-4db4-9c9a-1005668b7bbd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:09.387794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087383d4-e5d4-4d96-b4f7-db32153834cb None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:09.426591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:09.430098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e288a-312e-406e-95c6-f142d56de48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:09.432063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e288a-312e-406e-95c6-f142d56de48a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:09.432063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e288a-312e-406e-95c6-f142d56de48a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:09.432225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9e288a-312e-406e-95c6-f142d56de48a None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:09.435033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e288a-312e-406e-95c6-f142d56de48a None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:09.435692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9e288a-312e-406e-95c6-f142d56de48a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:09.437494 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 105/204] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:09 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:09.443651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e288a-312e-406e-95c6-f142d56de48a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:09.533123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 100/205] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:09.539357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087383d4-e5d4-4d96-b4f7-db32153834cb None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:09.554509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9e288a-312e-406e-95c6-f142d56de48a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:09.583541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:09.593682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce89a7-9a39-4e3c-ab31-14ec4c5832ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:09.594295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce89a7-9a39-4e3c-ab31-14ec4c5832ab None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:09.594573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce89a7-9a39-4e3c-ab31-14ec4c5832ab None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:09.594878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce89a7-9a39-4e3c-ab31-14ec4c5832ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:09.595980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce89a7-9a39-4e3c-ab31-14ec4c5832ab None admin] RBAC: Adding query filter params (role.id=4afb6e1cde9747919b7e855da11806b0, scope.project.id=e745821f0ace4177a3094a0f8a054926, user.id=3211f700bfdb4f0f86e422cf21fdbaaa) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:09.596086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce89a7-9a39-4e3c-ab31-14ec4c5832ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:09.597561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce89a7-9a39-4e3c-ab31-14ec4c5832ab None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:09.604205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 106/206] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:09 2022] GET /identity/v3/role_assignments?user.id=3211f700bfdb4f0f86e422cf21fdbaaa&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=4afb6e1cde9747919b7e855da11806b0 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:09.665363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087383d4-e5d4-4d96-b4f7-db32153834cb None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:09.708801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d890baf1-6405-4022-a80c-a3e925d1d08e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:09.709832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890baf1-6405-4022-a80c-a3e925d1d08e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:09.710298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890baf1-6405-4022-a80c-a3e925d1d08e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:09.710801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d890baf1-6405-4022-a80c-a3e925d1d08e None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:09.712178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890baf1-6405-4022-a80c-a3e925d1d08e None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:09.713847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d890baf1-6405-4022-a80c-a3e925d1d08e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:09.716413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 101/207] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:09 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:09.722260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce89a7-9a39-4e3c-ab31-14ec4c5832ab None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:09.821318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:09.867963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce89a7-9a39-4e3c-ab31-14ec4c5832ab None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:09.904099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c99658-0d29-4dda-8777-85210cd5f24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:09.904715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99658-0d29-4dda-8777-85210cd5f24c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:09.904994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99658-0d29-4dda-8777-85210cd5f24c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:09.905263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c99658-0d29-4dda-8777-85210cd5f24c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:09.906000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c99658-0d29-4dda-8777-85210cd5f24c None admin] RBAC: Adding query filter params (role.id=17053af642bb46de91cf75f9be9d458a, scope.project.id=1e153a5d02af48acaf1b20217342aed9, user.id=f6ae58b712d84ab4b7c45da21aca2d91) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:09.906307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c99658-0d29-4dda-8777-85210cd5f24c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:09.907929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c99658-0d29-4dda-8777-85210cd5f24c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:09.913988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 107/208] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:09 2022] GET /identity/v3/role_assignments?user.id=f6ae58b712d84ab4b7c45da21aca2d91&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=17053af642bb46de91cf75f9be9d458a => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:10.882863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230353e-373e-46a1-87f3-469f96801c62 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:10.883376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230353e-373e-46a1-87f3-469f96801c62 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:10.883450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230353e-373e-46a1-87f3-469f96801c62 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:10.884777 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 102/209] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:10.890706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1c9d3-4723-4a21-b323-59344c6c9d41 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:10.891130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1c9d3-4723-4a21-b323-59344c6c9d41 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:10.891284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c1c9d3-4723-4a21-b323-59344c6c9d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:10.911440 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f2c1c9d3-4723-4a21-b323-59344c6c9d41 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:10.912655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f2c1c9d3-4723-4a21-b323-59344c6c9d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:10.935973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b3df4-3cca-43b9-a998-33e2112dc0dd None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:10.936578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b3df4-3cca-43b9-a998-33e2112dc0dd None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:10.937034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05b3df4-3cca-43b9-a998-33e2112dc0dd None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:10.938561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 103/210] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:10.943690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857772db-0de6-4f11-a2e4-9b17c178b349 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:10.944189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857772db-0de6-4f11-a2e4-9b17c178b349 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:10.944668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857772db-0de6-4f11-a2e4-9b17c178b349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:10.963828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-857772db-0de6-4f11-a2e4-9b17c178b349 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:10.965559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-857772db-0de6-4f11-a2e4-9b17c178b349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:10.996157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 108/211] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:11.042043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 104/212] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:11.264060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1c9d3-4723-4a21-b323-59344c6c9d41 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:11.311859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857772db-0de6-4f11-a2e4-9b17c178b349 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:11.322131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:11.341466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:11.368190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c1c9d3-4723-4a21-b323-59344c6c9d41 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:11.408216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6a2ce8-ae35-46cf-a388-afb583f507e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:11.408850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a2ce8-ae35-46cf-a388-afb583f507e2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:11.409127 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a2ce8-ae35-46cf-a388-afb583f507e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:11.409397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6a2ce8-ae35-46cf-a388-afb583f507e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:11.410518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a2ce8-ae35-46cf-a388-afb583f507e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:11.412218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6a2ce8-ae35-46cf-a388-afb583f507e2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:11.413894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 109/213] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:11.416514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e4b2-fa08-44e1-af61-b57d51fa89c1 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:11.417037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e4b2-fa08-44e1-af61-b57d51fa89c1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:11.417321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd32e4b2-fa08-44e1-af61-b57d51fa89c1 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:11.422896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 110/214] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:11.424213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e4b2-fa08-44e1-af61-b57d51fa89c1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:11.430289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857772db-0de6-4f11-a2e4-9b17c178b349 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:11.469729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808f5a9-3257-42f6-8f5f-70db650a5370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:11.470570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808f5a9-3257-42f6-8f5f-70db650a5370 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:11.470675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808f5a9-3257-42f6-8f5f-70db650a5370 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:11.470927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808f5a9-3257-42f6-8f5f-70db650a5370 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:11.481411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808f5a9-3257-42f6-8f5f-70db650a5370 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-2808f5a9-3257-42f6-8f5f-70db650a5370 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:11.486154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:11.487059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 105/215] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:11.491509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc495a-933b-48a2-9901-89add1e08763 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:11.492220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc495a-933b-48a2-9901-89add1e08763 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:11.492220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dc495a-933b-48a2-9901-89add1e08763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:11.509385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-a8dc495a-933b-48a2-9901-89add1e08763 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:11.510568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a8dc495a-933b-48a2-9901-89add1e08763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:11.541741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd32e4b2-fa08-44e1-af61-b57d51fa89c1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:11.566286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:11.579116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61166499-ed44-4f4b-a316-1c22beb923fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:11.579804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61166499-ed44-4f4b-a316-1c22beb923fe None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:11.580078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61166499-ed44-4f4b-a316-1c22beb923fe None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:11.580344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61166499-ed44-4f4b-a316-1c22beb923fe None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:11.580993 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61166499-ed44-4f4b-a316-1c22beb923fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:11.582521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61166499-ed44-4f4b-a316-1c22beb923fe None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:11.589601 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 106/216] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:11.599163 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc495a-933b-48a2-9901-89add1e08763 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:11.613220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:11.620046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 111/217] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:11 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:11.720412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dc495a-933b-48a2-9901-89add1e08763 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:11.767537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0db2a3-dad6-4a86-b25c-5b31c8547257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:11.768176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0db2a3-dad6-4a86-b25c-5b31c8547257 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:11.768454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0db2a3-dad6-4a86-b25c-5b31c8547257 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:11.768730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0db2a3-dad6-4a86-b25c-5b31c8547257 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:11.769423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0db2a3-dad6-4a86-b25c-5b31c8547257 None admin] RBAC: Adding query filter params (name=member) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:11.769723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0db2a3-dad6-4a86-b25c-5b31c8547257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:11.771738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0db2a3-dad6-4a86-b25c-5b31c8547257 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:11.788093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 107/218] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:11.793858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61166499-ed44-4f4b-a316-1c22beb923fe None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:11.869733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0db2a3-dad6-4a86-b25c-5b31c8547257 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:11.916363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61166499-ed44-4f4b-a316-1c22beb923fe None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:11.958097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f608c3-e82e-4d02-9bda-c812b0784f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:11.958740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f608c3-e82e-4d02-9bda-c812b0784f6a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:11.959054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f608c3-e82e-4d02-9bda-c812b0784f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:11.959328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f608c3-e82e-4d02-9bda-c812b0784f6a None admin] PATH_INFO: `/v3/users/1d811ddb331f478baec4c3484649a8df` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:11.970294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:11.978270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f608c3-e82e-4d02-9bda-c812b0784f6a None admin] RBAC: Authorizing `identity:get_user(user_id=1d811ddb331f478baec4c3484649a8df)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:11.980307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f608c3-e82e-4d02-9bda-c812b0784f6a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:11.982646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 112/219] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:11 2022] GET /identity/v3/users/1d811ddb331f478baec4c3484649a8df => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:11.986794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2c10-5759-4e1a-8c56-23f88d87e5a3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:11.986794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2c10-5759-4e1a-8c56-23f88d87e5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:11.986794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb2c10-5759-4e1a-8c56-23f88d87e5a3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:11.986794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 113/220] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:11.990131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb2c10-5759-4e1a-8c56-23f88d87e5a3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:12.002420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0db2a3-dad6-4a86-b25c-5b31c8547257 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:12.037914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:12.047424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8dab24b-bc37-4d74-8e8d-3dd576854313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:12.048086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dab24b-bc37-4d74-8e8d-3dd576854313 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:12.048361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dab24b-bc37-4d74-8e8d-3dd576854313 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:12.048630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8dab24b-bc37-4d74-8e8d-3dd576854313 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:12.065048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8dab24b-bc37-4d74-8e8d-3dd576854313 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-b8dab24b-bc37-4d74-8e8d-3dd576854313 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:12.070790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:12.071658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:12.072449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:12.074839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 108/221] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:12.076261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070b60-6d82-4f40-ae14-8404b620cbb5 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:12.076768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070b60-6d82-4f40-ae14-8404b620cbb5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:12.077176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070b60-6d82-4f40-ae14-8404b620cbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:12.095755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-33070b60-6d82-4f40-ae14-8404b620cbb5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:12.097298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-33070b60-6d82-4f40-ae14-8404b620cbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:12.115873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb2c10-5759-4e1a-8c56-23f88d87e5a3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:12.159861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c0ee-8654-4f7f-8acc-0e9a2e4ef9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:12.160691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c0ee-8654-4f7f-8acc-0e9a2e4ef9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:12.160970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c0ee-8654-4f7f-8acc-0e9a2e4ef9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:12.161237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef88c0ee-8654-4f7f-8acc-0e9a2e4ef9a0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:12.172311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 109/222] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:12.178054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33070b60-6d82-4f40-ae14-8404b620cbb5 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:12.238619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88c0ee-8654-4f7f-8acc-0e9a2e4ef9a0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:12.240131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef88c0ee-8654-4f7f-8acc-0e9a2e4ef9a0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:12.285152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:12.344502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:12.354683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 114/223] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:12.361373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c0ee-8654-4f7f-8acc-0e9a2e4ef9a0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:12.456816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33070b60-6d82-4f40-ae14-8404b620cbb5 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:12.467176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef88c0ee-8654-4f7f-8acc-0e9a2e4ef9a0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:12.502902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a37c4-b6e2-42db-a81b-92fa2b7d2ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:12.503535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a37c4-b6e2-42db-a81b-92fa2b7d2ce8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:12.503812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a37c4-b6e2-42db-a81b-92fa2b7d2ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:12.504080 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a37c4-b6e2-42db-a81b-92fa2b7d2ce8 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:12.505365 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a37c4-b6e2-42db-a81b-92fa2b7d2ce8 None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:12.507203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a37c4-b6e2-42db-a81b-92fa2b7d2ce8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:12.509153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 115/224] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:12 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:12.515472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a37c4-b6e2-42db-a81b-92fa2b7d2ce8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:12.525805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:12.575479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a02e4-0486-403f-bb71-b6e86e3ef213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:12.576385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a02e4-0486-403f-bb71-b6e86e3ef213 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:12.576804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a02e4-0486-403f-bb71-b6e86e3ef213 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:12.577213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332a02e4-0486-403f-bb71-b6e86e3ef213 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:12.578026 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a02e4-0486-403f-bb71-b6e86e3ef213 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:12.578471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a02e4-0486-403f-bb71-b6e86e3ef213 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:12.580038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332a02e4-0486-403f-bb71-b6e86e3ef213 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:12.591928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 110/225] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:12.592992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a02e4-0486-403f-bb71-b6e86e3ef213 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:12.626724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a37c4-b6e2-42db-a81b-92fa2b7d2ce8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:12.662622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41387b-e413-4870-a92e-1809d80e0e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:12.663270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41387b-e413-4870-a92e-1809d80e0e6c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:12.663542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41387b-e413-4870-a92e-1809d80e0e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:12.663808 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41387b-e413-4870-a92e-1809d80e0e6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:12.664974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41387b-e413-4870-a92e-1809d80e0e6c None admin] RBAC: Adding query filter params (role.id=fc85aab66ae3471dbebf6a8340dbd444, scope.project.id=1e153a5d02af48acaf1b20217342aed9, user.id=1d811ddb331f478baec4c3484649a8df) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:12.665296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41387b-e413-4870-a92e-1809d80e0e6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:12.667237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b41387b-e413-4870-a92e-1809d80e0e6c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:12.674403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 116/226] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:12 2022] GET /identity/v3/role_assignments?user.id=1d811ddb331f478baec4c3484649a8df&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:12.678881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41387b-e413-4870-a92e-1809d80e0e6c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:12.757441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332a02e4-0486-403f-bb71-b6e86e3ef213 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:12.825331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:12.826274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:12.838567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0953d-3e17-47a2-b7d3-5813a525a8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:12.839314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0953d-3e17-47a2-b7d3-5813a525a8bc None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:12.839662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0953d-3e17-47a2-b7d3-5813a525a8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:12.841812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a0953d-3e17-47a2-b7d3-5813a525a8bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:12.861691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a0953d-3e17-47a2-b7d3-5813a525a8bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-a5a0953d-3e17-47a2-b7d3-5813a525a8bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:12.869641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:12.870531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:12.871637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 111/227] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:12.876552 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0953d-3e17-47a2-b7d3-5813a525a8bc None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:12.893577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41387b-e413-4870-a92e-1809d80e0e6c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:12.966224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521d75-a893-45e0-9f54-62072ba1e5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:12.968712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521d75-a893-45e0-9f54-62072ba1e5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:12.971420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521d75-a893-45e0-9f54-62072ba1e5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:12.971890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65521d75-a893-45e0-9f54-62072ba1e5a9 None admin] PATH_INFO: `/v3/users/f6ae58b712d84ab4b7c45da21aca2d91` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:12.973324 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521d75-a893-45e0-9f54-62072ba1e5a9 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ae58b712d84ab4b7c45da21aca2d91)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:12.975009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65521d75-a893-45e0-9f54-62072ba1e5a9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:12.979757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 117/228] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:12 2022] GET /identity/v3/users/f6ae58b712d84ab4b7c45da21aca2d91 => generated 283 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:12.985392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521d75-a893-45e0-9f54-62072ba1e5a9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:13.069804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a0953d-3e17-47a2-b7d3-5813a525a8bc None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:13.140323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a0e1a-7246-4c8f-a0c6-1e065c2ed248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:13.141405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a0e1a-7246-4c8f-a0c6-1e065c2ed248 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.141870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a0e1a-7246-4c8f-a0c6-1e065c2ed248 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.142328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a0e1a-7246-4c8f-a0c6-1e065c2ed248 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.143228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a0e1a-7246-4c8f-a0c6-1e065c2ed248 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:13.143811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a0e1a-7246-4c8f-a0c6-1e065c2ed248 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:13.145595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a0e1a-7246-4c8f-a0c6-1e065c2ed248 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:13.162050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 112/229] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:13.163580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65521d75-a893-45e0-9f54-62072ba1e5a9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:13.168778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a0e1a-7246-4c8f-a0c6-1e065c2ed248 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:13.239470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7a443-afec-4527-a617-2567c5ae04bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:13.240109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7a443-afec-4527-a617-2567c5ae04bf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.240384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7a443-afec-4527-a617-2567c5ae04bf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.240653 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab7a443-afec-4527-a617-2567c5ae04bf None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.242226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7a443-afec-4527-a617-2567c5ae04bf None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:13.242657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:13.243728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab7a443-afec-4527-a617-2567c5ae04bf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:13.246913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 118/230] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:12 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:13.252881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7a443-afec-4527-a617-2567c5ae04bf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:13.266725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:13.334132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a0e1a-7246-4c8f-a0c6-1e065c2ed248 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:13.367658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab7a443-afec-4527-a617-2567c5ae04bf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:13.403865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4b6e-eac1-4119-9c16-8d99ddeade08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:13.404540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4b6e-eac1-4119-9c16-8d99ddeade08 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.404808 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4b6e-eac1-4119-9c16-8d99ddeade08 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.405079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cd4b6e-eac1-4119-9c16-8d99ddeade08 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9/users/f6ae58b712d84ab4b7c45da21aca2d91/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.407072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd4b6e-eac1-4119-9c16-8d99ddeade08 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e153a5d02af48acaf1b20217342aed9, user_id=f6ae58b712d84ab4b7c45da21aca2d91, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:13.407311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b26bd-586d-47cb-bf71-eee22f0a688e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:13.407963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b26bd-586d-47cb-bf71-eee22f0a688e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.408241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b26bd-586d-47cb-bf71-eee22f0a688e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.408510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8b26bd-586d-47cb-bf71-eee22f0a688e None admin] PATH_INFO: `/v3/users/f6ae58b712d84ab4b7c45da21aca2d91` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.408604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cd4b6e-eac1-4119-9c16-8d99ddeade08 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:13.409684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b26bd-586d-47cb-bf71-eee22f0a688e None admin] RBAC: Authorizing `identity:get_user(user_id=f6ae58b712d84ab4b7c45da21aca2d91)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:13.411265 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8b26bd-586d-47cb-bf71-eee22f0a688e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:13.413100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 113/231] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:13 2022] GET /identity/v3/users/f6ae58b712d84ab4b7c45da21aca2d91 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:13.419170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b26bd-586d-47cb-bf71-eee22f0a688e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:13.431223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 119/232] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:13 2022] PUT /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9/users/f6ae58b712d84ab4b7c45da21aca2d91/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:13.548946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8b26bd-586d-47cb-bf71-eee22f0a688e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:13.579510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:13.593524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9081cc4-c8d2-45fd-b3d5-dfe1e7ad8589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:13.594091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9081cc4-c8d2-45fd-b3d5-dfe1e7ad8589 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.594372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9081cc4-c8d2-45fd-b3d5-dfe1e7ad8589 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.594753 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9081cc4-c8d2-45fd-b3d5-dfe1e7ad8589 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.595950 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9081cc4-c8d2-45fd-b3d5-dfe1e7ad8589 None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:13.597486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9081cc4-c8d2-45fd-b3d5-dfe1e7ad8589 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:13.599472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 114/233] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:13 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:13.605482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4b6e-eac1-4119-9c16-8d99ddeade08 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:13.677701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:13.715280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cd4b6e-eac1-4119-9c16-8d99ddeade08 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:13.750890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329a64f1-80a4-41df-9f5a-5d352306a134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:13.751862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a64f1-80a4-41df-9f5a-5d352306a134 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.752340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a64f1-80a4-41df-9f5a-5d352306a134 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.752782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329a64f1-80a4-41df-9f5a-5d352306a134 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9/users/f6ae58b712d84ab4b7c45da21aca2d91/roles/17053af642bb46de91cf75f9be9d458a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.755254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a64f1-80a4-41df-9f5a-5d352306a134 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e153a5d02af48acaf1b20217342aed9, user_id=f6ae58b712d84ab4b7c45da21aca2d91, role_id=17053af642bb46de91cf75f9be9d458a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:13.756874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329a64f1-80a4-41df-9f5a-5d352306a134 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:13.778801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 120/234] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:13 2022] PUT /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9/users/f6ae58b712d84ab4b7c45da21aca2d91/roles/17053af642bb46de91cf75f9be9d458a => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:13.949980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26f80c-fc67-4e56-a418-610ae143f14e None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.950280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26f80c-fc67-4e56-a418-610ae143f14e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.950441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef26f80c-fc67-4e56-a418-610ae143f14e None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.951880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 115/235] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:13.957765 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f114d-af70-4819-9762-8972c8211190 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:13.958124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f114d-af70-4819-9762-8972c8211190 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:13.958401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737f114d-af70-4819-9762-8972c8211190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:13.987882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-737f114d-af70-4819-9762-8972c8211190 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:13.989212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-737f114d-af70-4819-9762-8972c8211190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:14.065376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 121/236] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:14.077573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101067-5085-459f-b6c8-c6659cb584dc None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:14.078082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101067-5085-459f-b6c8-c6659cb584dc None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:14.078167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7101067-5085-459f-b6c8-c6659cb584dc None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:14.079847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 116/237] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:14.085248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43600fad-abd4-4bfd-9e5f-7938a1be2cd6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:14.085534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43600fad-abd4-4bfd-9e5f-7938a1be2cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:14.085804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43600fad-abd4-4bfd-9e5f-7938a1be2cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:14.108080 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-43600fad-abd4-4bfd-9e5f-7938a1be2cd6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:14.109272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-43600fad-abd4-4bfd-9e5f-7938a1be2cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:14.175487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:14.199676 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 122/238] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:14.346880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7101067-5085-459f-b6c8-c6659cb584dc None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:14.468559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7101067-5085-459f-b6c8-c6659cb584dc None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:14.504204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3770bee-2ca0-442d-ba13-1ef7d43f0499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:14.504845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770bee-2ca0-442d-ba13-1ef7d43f0499 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:14.505176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770bee-2ca0-442d-ba13-1ef7d43f0499 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:14.505449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3770bee-2ca0-442d-ba13-1ef7d43f0499 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:14.516718 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3770bee-2ca0-442d-ba13-1ef7d43f0499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-b3770bee-2ca0-442d-ba13-1ef7d43f0499 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:14.521844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:14.522715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:14.523535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 117/239] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:14.528890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43600fad-abd4-4bfd-9e5f-7938a1be2cd6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:14.612088 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3770bee-2ca0-442d-ba13-1ef7d43f0499 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:14.709992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:14.718904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43600fad-abd4-4bfd-9e5f-7938a1be2cd6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:14.780994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3770bee-2ca0-442d-ba13-1ef7d43f0499 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:14.793134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c13e-e57d-45b1-a61b-13d36e0b3016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:14.793909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c13e-e57d-45b1-a61b-13d36e0b3016 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:14.794192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c13e-e57d-45b1-a61b-13d36e0b3016 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:14.794461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a28c13e-e57d-45b1-a61b-13d36e0b3016 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:14.795175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28c13e-e57d-45b1-a61b-13d36e0b3016 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:14.795476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28c13e-e57d-45b1-a61b-13d36e0b3016 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:14.798211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a28c13e-e57d-45b1-a61b-13d36e0b3016 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:14.808232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 123/240] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:14.814151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c13e-e57d-45b1-a61b-13d36e0b3016 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:14.857095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705db25-8131-443a-95de-3fdaed8ea138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:14.858489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705db25-8131-443a-95de-3fdaed8ea138 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:14.858806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705db25-8131-443a-95de-3fdaed8ea138 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:14.859053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705db25-8131-443a-95de-3fdaed8ea138 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:14.860352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705db25-8131-443a-95de-3fdaed8ea138 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:14.862727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705db25-8131-443a-95de-3fdaed8ea138 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:14.865249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 118/241] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:14.871467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705db25-8131-443a-95de-3fdaed8ea138 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:14.923409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:15.000169 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a28c13e-e57d-45b1-a61b-13d36e0b3016 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:15.022921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705db25-8131-443a-95de-3fdaed8ea138 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:15.038335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfcc46c-aea9-458e-8403-a2cd0f9fd2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:15.039345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc46c-aea9-458e-8403-a2cd0f9fd2a0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:15.039763 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc46c-aea9-458e-8403-a2cd0f9fd2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:15.040326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:15.041274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfcc46c-aea9-458e-8403-a2cd0f9fd2a0 None admin] PATH_INFO: `/v3/users/fe465c9b473e44aea48e8e10afeb472d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:15.057574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745fc87-6fd1-4109-bf21-8ac095e815fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:15.058338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fc87-6fd1-4109-bf21-8ac095e815fe None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:15.058587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fc87-6fd1-4109-bf21-8ac095e815fe None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:15.058892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fc87-6fd1-4109-bf21-8ac095e815fe None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:15.059404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcc46c-aea9-458e-8403-a2cd0f9fd2a0 None admin] RBAC: Authorizing `identity:get_user(user_id=fe465c9b473e44aea48e8e10afeb472d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:15.059516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745fc87-6fd1-4109-bf21-8ac095e815fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:15.060967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d745fc87-6fd1-4109-bf21-8ac095e815fe None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:15.061252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfcc46c-aea9-458e-8403-a2cd0f9fd2a0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:15.063448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 124/242] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:14 2022] GET /identity/v3/users/fe465c9b473e44aea48e8e10afeb472d => generated 297 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:15.064776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337abe59-db1c-438f-9662-5a8863a500b6 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:15.065193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337abe59-db1c-438f-9662-5a8863a500b6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:15.065599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337abe59-db1c-438f-9662-5a8863a500b6 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:15.066984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 125/243] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:15.068792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337abe59-db1c-438f-9662-5a8863a500b6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:15.095057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 119/244] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:14 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:15.096594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dff551-044d-49f8-823b-7ac2cf624753 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:15.096898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dff551-044d-49f8-823b-7ac2cf624753 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:15.097293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dff551-044d-49f8-823b-7ac2cf624753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:15.130846 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-e8dff551-044d-49f8-823b-7ac2cf624753 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:15.131933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e8dff551-044d-49f8-823b-7ac2cf624753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:15.190937 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337abe59-db1c-438f-9662-5a8863a500b6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:15.199934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:15.231822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dfe8e-bc52-4b71-8da9-880902fd797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:15.232739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dfe8e-bc52-4b71-8da9-880902fd797d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:15.233228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dfe8e-bc52-4b71-8da9-880902fd797d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:15.233635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dfe8e-bc52-4b71-8da9-880902fd797d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:15.270918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 120/245] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:15.315170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dfe8e-bc52-4b71-8da9-880902fd797d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:15.316976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dfe8e-bc52-4b71-8da9-880902fd797d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:15.427992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 126/246] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:52:15.433612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dff551-044d-49f8-823b-7ac2cf624753 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:15.559653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dff551-044d-49f8-823b-7ac2cf624753 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:15.562461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:15.594358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dfe8e-bc52-4b71-8da9-880902fd797d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:15.604277 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:15.606879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc96a1-8f9c-4999-8030-4eddb6c3cce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:15.607549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc96a1-8f9c-4999-8030-4eddb6c3cce1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:15.607826 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc96a1-8f9c-4999-8030-4eddb6c3cce1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:15.608131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dc96a1-8f9c-4999-8030-4eddb6c3cce1 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:15.609574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc96a1-8f9c-4999-8030-4eddb6c3cce1 None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:15.610806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dc96a1-8f9c-4999-8030-4eddb6c3cce1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:15.612758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 121/247] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:15 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:15.618942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc96a1-8f9c-4999-8030-4eddb6c3cce1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:15.765479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dfe8e-bc52-4b71-8da9-880902fd797d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:15.784900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dc96a1-8f9c-4999-8030-4eddb6c3cce1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:15.812052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f5a6c-2dec-437f-9eb3-b6a375a90da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:15.813188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5a6c-2dec-437f-9eb3-b6a375a90da7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:15.813598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5a6c-2dec-437f-9eb3-b6a375a90da7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:15.814125 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f5a6c-2dec-437f-9eb3-b6a375a90da7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:15.827757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb0424c-0900-4d2b-8e56-1b3c6d7a6ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:15.828045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-507f5a6c-2dec-437f-9eb3-b6a375a90da7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:15.828143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0424c-0900-4d2b-8e56-1b3c6d7a6ed2 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:15.828312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0424c-0900-4d2b-8e56-1b3c6d7a6ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:15.828583 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb0424c-0900-4d2b-8e56-1b3c6d7a6ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:15.830348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0424c-0900-4d2b-8e56-1b3c6d7a6ed2 None admin] RBAC: Adding query filter params (role.id=4afb6e1cde9747919b7e855da11806b0, scope.project.id=1e153a5d02af48acaf1b20217342aed9, user.id=fe465c9b473e44aea48e8e10afeb472d) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:15.830348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0424c-0900-4d2b-8e56-1b3c6d7a6ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:15.831565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb0424c-0900-4d2b-8e56-1b3c6d7a6ed2 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-507f5a6c-2dec-437f-9eb3-b6a375a90da7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:15.833538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:15.834381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:15.835207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 127/248] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:15.838359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e3d60-8087-4d39-9646-2a5331164220 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:15.838359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e3d60-8087-4d39-9646-2a5331164220 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:15.838359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7e3d60-8087-4d39-9646-2a5331164220 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:15.838867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 122/249] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:15 2022] GET /identity/v3/role_assignments?user.id=fe465c9b473e44aea48e8e10afeb472d&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=4afb6e1cde9747919b7e855da11806b0 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:15.839421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 128/250] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:15.845318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98709a9-1340-48fc-9a1e-beeca2102581 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:15.845604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98709a9-1340-48fc-9a1e-beeca2102581 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:15.845867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98709a9-1340-48fc-9a1e-beeca2102581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:15.849722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e3d60-8087-4d39-9646-2a5331164220 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:15.868937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-f98709a9-1340-48fc-9a1e-beeca2102581 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:15.870357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f98709a9-1340-48fc-9a1e-beeca2102581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:15.923219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:15.957656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:16.001660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7e3d60-8087-4d39-9646-2a5331164220 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:16.029361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 123/251] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:16.039605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a96c7-dcf8-489b-897b-c5b567605628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:16.040549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a96c7-dcf8-489b-897b-c5b567605628 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:16.041015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a96c7-dcf8-489b-897b-c5b567605628 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:16.041524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a96c7-dcf8-489b-897b-c5b567605628 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:16.042513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a96c7-dcf8-489b-897b-c5b567605628 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:16.043181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a96c7-dcf8-489b-897b-c5b567605628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:16.044857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a96c7-dcf8-489b-897b-c5b567605628 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:16.053990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 129/252] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:16.060060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98709a9-1340-48fc-9a1e-beeca2102581 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:16.174324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98709a9-1340-48fc-9a1e-beeca2102581 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:16.216603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90001865-44be-469f-b7d2-9a116bc385d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:16.217674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001865-44be-469f-b7d2-9a116bc385d1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:16.218140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001865-44be-469f-b7d2-9a116bc385d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:16.218591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90001865-44be-469f-b7d2-9a116bc385d1 None admin] PATH_INFO: `/v3/users/1d811ddb331f478baec4c3484649a8df` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:16.222955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90001865-44be-469f-b7d2-9a116bc385d1 None admin] RBAC: Authorizing `identity:get_user(user_id=1d811ddb331f478baec4c3484649a8df)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:16.224657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90001865-44be-469f-b7d2-9a116bc385d1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:16.226586 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 124/253] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:16 2022] GET /identity/v3/users/1d811ddb331f478baec4c3484649a8df => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:16.232784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a96c7-dcf8-489b-897b-c5b567605628 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:16.352377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93723df-164b-4bfe-b99d-79b896546d23 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:16.352972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93723df-164b-4bfe-b99d-79b896546d23 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:16.353487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93723df-164b-4bfe-b99d-79b896546d23 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:16.355182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 125/254] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:16.361554 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992762ac-e223-4213-ad61-5126cd7aa0a6 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:16.362081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992762ac-e223-4213-ad61-5126cd7aa0a6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:16.362382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a96c7-dcf8-489b-897b-c5b567605628 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:16.362759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992762ac-e223-4213-ad61-5126cd7aa0a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:16.385305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-992762ac-e223-4213-ad61-5126cd7aa0a6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:16.387018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-992762ac-e223-4213-ad61-5126cd7aa0a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:16.412514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:16.430795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c18018-8280-4eda-a266-864808438e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:16.430795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c18018-8280-4eda-a266-864808438e8b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:16.430795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c18018-8280-4eda-a266-864808438e8b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:16.430795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c18018-8280-4eda-a266-864808438e8b None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:16.431190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c18018-8280-4eda-a266-864808438e8b None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:16.431920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c18018-8280-4eda-a266-864808438e8b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:16.434108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 130/255] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:16 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:16.439623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:16.442334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c18018-8280-4eda-a266-864808438e8b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:16.521600 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 126/256] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:16.581595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c18018-8280-4eda-a266-864808438e8b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:16.621250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7907594-19d7-4c4d-b81a-2b2597e2cf96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:16.621899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7907594-19d7-4c4d-b81a-2b2597e2cf96 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:16.622175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7907594-19d7-4c4d-b81a-2b2597e2cf96 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:16.622438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7907594-19d7-4c4d-b81a-2b2597e2cf96 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9/users/1d811ddb331f478baec4c3484649a8df/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:16.624515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7907594-19d7-4c4d-b81a-2b2597e2cf96 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e153a5d02af48acaf1b20217342aed9, user_id=1d811ddb331f478baec4c3484649a8df, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:16.625972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7907594-19d7-4c4d-b81a-2b2597e2cf96 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:16.654246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 131/257] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:16 2022] PUT /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9/users/1d811ddb331f478baec4c3484649a8df/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:16.671991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992762ac-e223-4213-ad61-5126cd7aa0a6 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:16.805186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992762ac-e223-4213-ad61-5126cd7aa0a6 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:16.847687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369e2f-b152-4a93-a5b6-096ae1bebba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:16.848341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369e2f-b152-4a93-a5b6-096ae1bebba3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:16.848673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369e2f-b152-4a93-a5b6-096ae1bebba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:16.848946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75369e2f-b152-4a93-a5b6-096ae1bebba3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:16.865106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75369e2f-b152-4a93-a5b6-096ae1bebba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-75369e2f-b152-4a93-a5b6-096ae1bebba3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:16.869980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:16.870940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:16.871795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 127/258] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:16.877205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7907594-19d7-4c4d-b81a-2b2597e2cf96 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:16.960189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:17.012826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7907594-19d7-4c4d-b81a-2b2597e2cf96 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:17.051170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3464118-6e32-42f1-b792-16535441dab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:17.051797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464118-6e32-42f1-b792-16535441dab9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.052070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464118-6e32-42f1-b792-16535441dab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.052336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3464118-6e32-42f1-b792-16535441dab9 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.053020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3464118-6e32-42f1-b792-16535441dab9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:17.053316 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3464118-6e32-42f1-b792-16535441dab9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:17.054698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3464118-6e32-42f1-b792-16535441dab9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:17.064047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 132/259] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:17.069488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369e2f-b152-4a93-a5b6-096ae1bebba3 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:17.100637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:17.183200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3464118-6e32-42f1-b792-16535441dab9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:17.197305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75369e2f-b152-4a93-a5b6-096ae1bebba3 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:17.256526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e98248-7396-4977-8780-8e7d70863eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:17.257497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e98248-7396-4977-8780-8e7d70863eb2 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.257776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e98248-7396-4977-8780-8e7d70863eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.258047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e98248-7396-4977-8780-8e7d70863eb2 None admin] PATH_INFO: `/v3/users/f6ae58b712d84ab4b7c45da21aca2d91` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.262008 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e98248-7396-4977-8780-8e7d70863eb2 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ae58b712d84ab4b7c45da21aca2d91)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:17.263776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e98248-7396-4977-8780-8e7d70863eb2 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:17.270744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 128/260] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:17 2022] GET /identity/v3/users/f6ae58b712d84ab4b7c45da21aca2d91 => generated 283 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:17.284683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e98248-7396-4977-8780-8e7d70863eb2 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:17.397966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3464118-6e32-42f1-b792-16535441dab9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:17.419189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:17.431227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:17.434982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339bb78-c3cb-456d-8755-f98468da894a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:17.435565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bb78-c3cb-456d-8755-f98468da894a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.435839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bb78-c3cb-456d-8755-f98468da894a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.436109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339bb78-c3cb-456d-8755-f98468da894a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.447686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e98248-7396-4977-8780-8e7d70863eb2 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:17.453621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339bb78-c3cb-456d-8755-f98468da894a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9339bb78-c3cb-456d-8755-f98468da894a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:17.464272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:17.465341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:17.466201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 133/261] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:17.472228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339bb78-c3cb-456d-8755-f98468da894a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:17.513892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfe624-e826-4b34-8f7d-6f6c84ae3858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:17.514505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfe624-e826-4b34-8f7d-6f6c84ae3858 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.514793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfe624-e826-4b34-8f7d-6f6c84ae3858 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.515073 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bfe624-e826-4b34-8f7d-6f6c84ae3858 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.639981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfe624-e826-4b34-8f7d-6f6c84ae3858 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:17.641480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bfe624-e826-4b34-8f7d-6f6c84ae3858 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:17.657123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339bb78-c3cb-456d-8755-f98468da894a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:17.719241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda5034-8307-4d75-8914-d9884f9ededf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:17.719771 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda5034-8307-4d75-8914-d9884f9ededf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.720048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda5034-8307-4d75-8914-d9884f9ededf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.720316 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fda5034-8307-4d75-8914-d9884f9ededf None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.720987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda5034-8307-4d75-8914-d9884f9ededf None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:17.721285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda5034-8307-4d75-8914-d9884f9ededf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:17.722687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fda5034-8307-4d75-8914-d9884f9ededf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:17.744282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 134/262] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:17.748652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda5034-8307-4d75-8914-d9884f9ededf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:17.804245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:17.822217 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 129/263] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:52:17.828069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfe624-e826-4b34-8f7d-6f6c84ae3858 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:17.833282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:17.938511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fda5034-8307-4d75-8914-d9884f9ededf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:17.962120 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bfe624-e826-4b34-8f7d-6f6c84ae3858 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:17.978364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650b77f-e978-4e61-bfb1-1c3aee536c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:17.979479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650b77f-e978-4e61-bfb1-1c3aee536c28 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:17.980009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650b77f-e978-4e61-bfb1-1c3aee536c28 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:17.980481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650b77f-e978-4e61-bfb1-1c3aee536c28 None admin] PATH_INFO: `/v3/users/f6ae58b712d84ab4b7c45da21aca2d91` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:17.982036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650b77f-e978-4e61-bfb1-1c3aee536c28 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ae58b712d84ab4b7c45da21aca2d91)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:17.983854 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650b77f-e978-4e61-bfb1-1c3aee536c28 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:17.985739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 135/264] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:17 2022] GET /identity/v3/users/f6ae58b712d84ab4b7c45da21aca2d91 => generated 283 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:17.991669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650b77f-e978-4e61-bfb1-1c3aee536c28 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.018533 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cc52a-af72-4c60-8360-0742213d76f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:18.019747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc52a-af72-4c60-8360-0742213d76f4 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.021323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc52a-af72-4c60-8360-0742213d76f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.021951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0cc52a-af72-4c60-8360-0742213d76f4 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.024637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cc52a-af72-4c60-8360-0742213d76f4 None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:18.027290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0cc52a-af72-4c60-8360-0742213d76f4 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:18.031836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 130/265] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:17 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:18.037652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cc52a-af72-4c60-8360-0742213d76f4 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.155082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:18.178668 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650b77f-e978-4e61-bfb1-1c3aee536c28 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:18.190624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:18.220633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0cc52a-af72-4c60-8360-0742213d76f4 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:18.234712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0545b8-c485-43f0-be09-8930d060ddc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:18.235727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0545b8-c485-43f0-be09-8930d060ddc9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.236223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0545b8-c485-43f0-be09-8930d060ddc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.236682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0545b8-c485-43f0-be09-8930d060ddc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.295520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ca2ac5-baf6-4fa3-a376-5741aeb1ffb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:18.296160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2ac5-baf6-4fa3-a376-5741aeb1ffb0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.296443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2ac5-baf6-4fa3-a376-5741aeb1ffb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.296715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ca2ac5-baf6-4fa3-a376-5741aeb1ffb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.297466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca2ac5-baf6-4fa3-a376-5741aeb1ffb0 None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=1e153a5d02af48acaf1b20217342aed9, user.id=f6ae58b712d84ab4b7c45da21aca2d91) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:18.297759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca2ac5-baf6-4fa3-a376-5741aeb1ffb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:18.299323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ca2ac5-baf6-4fa3-a376-5741aeb1ffb0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:18.310500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 131/266] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:18 2022] GET /identity/v3/role_assignments?user.id=f6ae58b712d84ab4b7c45da21aca2d91&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=85a146946817410b9a3addcf041c5909 => generated 608 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:18.316232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0545b8-c485-43f0-be09-8930d060ddc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:18.318047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0545b8-c485-43f0-be09-8930d060ddc9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:18.380980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89a728-570b-4ee3-991a-e372e13e378f None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.381297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89a728-570b-4ee3-991a-e372e13e378f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.381561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d89a728-570b-4ee3-991a-e372e13e378f None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.389242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 132/267] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:18.394791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4398-4480-4bb6-9a98-de66abbbb855 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.395074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4398-4480-4bb6-9a98-de66abbbb855 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.395346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda4398-4480-4bb6-9a98-de66abbbb855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.432191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 136/268] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:52:18.436877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ecda4398-4480-4bb6-9a98-de66abbbb855 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:18.438065 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0545b8-c485-43f0-be09-8930d060ddc9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.438185 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ecda4398-4480-4bb6-9a98-de66abbbb855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:18.449850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:18.565197 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0545b8-c485-43f0-be09-8930d060ddc9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:18.571705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 133/269] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:18.576792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7ae0c-a3d1-4c97-89ee-84fa4a656590 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.577056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7ae0c-a3d1-4c97-89ee-84fa4a656590 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.577346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d7ae0c-a3d1-4c97-89ee-84fa4a656590 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.578996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 134/270] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:18.581219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb68f-cf60-4fde-93b4-c02144e38d27 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.581476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb68f-cf60-4fde-93b4-c02144e38d27 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.581773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdbb68f-cf60-4fde-93b4-c02144e38d27 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.585484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 135/271] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:18.587908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4d01-89ec-4e70-8bbb-2ddf54e0cc48 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.588409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4d01-89ec-4e70-8bbb-2ddf54e0cc48 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.588922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d4d01-89ec-4e70-8bbb-2ddf54e0cc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.613655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576a56b-6b5e-4c36-8174-4df8395c9a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:18.614291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576a56b-6b5e-4c36-8174-4df8395c9a8d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.614625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576a56b-6b5e-4c36-8174-4df8395c9a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.614933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576a56b-6b5e-4c36-8174-4df8395c9a8d None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.615371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-f42d4d01-89ec-4e70-8bbb-2ddf54e0cc48 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:18.616163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576a56b-6b5e-4c36-8174-4df8395c9a8d None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:18.616869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f42d4d01-89ec-4e70-8bbb-2ddf54e0cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:18.617868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d576a56b-6b5e-4c36-8174-4df8395c9a8d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:18.620161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 137/272] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:18 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:18.625823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1a90f-2e38-4a32-80ec-ad408c0e872e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.625823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1a90f-2e38-4a32-80ec-ad408c0e872e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.625823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e1a90f-2e38-4a32-80ec-ad408c0e872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.646958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-22e1a90f-2e38-4a32-80ec-ad408c0e872e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:18.648259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-22e1a90f-2e38-4a32-80ec-ad408c0e872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:18.687990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:18.713114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 136/273] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:18.714508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4d01-89ec-4e70-8bbb-2ddf54e0cc48 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.758504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 138/274] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:18.847324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d4d01-89ec-4e70-8bbb-2ddf54e0cc48 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:18.890279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720cfb4-f46d-497b-b6a4-18bcf086ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:18.890919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720cfb4-f46d-497b-b6a4-18bcf086ec84 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:18.891194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720cfb4-f46d-497b-b6a4-18bcf086ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:18.891461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720cfb4-f46d-497b-b6a4-18bcf086ec84 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:18.892477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720cfb4-f46d-497b-b6a4-18bcf086ec84 None admin] RBAC: Adding query filter params (role.id=17053af642bb46de91cf75f9be9d458a, scope.project.id=1e153a5d02af48acaf1b20217342aed9, user.id=f6ae58b712d84ab4b7c45da21aca2d91) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:18.892779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720cfb4-f46d-497b-b6a4-18bcf086ec84 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:18.894269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720cfb4-f46d-497b-b6a4-18bcf086ec84 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:18.900962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 137/275] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:18 2022] GET /identity/v3/role_assignments?user.id=f6ae58b712d84ab4b7c45da21aca2d91&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=17053af642bb46de91cf75f9be9d458a => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:18.967760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1a90f-2e38-4a32-80ec-ad408c0e872e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:18.977575 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.077951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720cfb4-f46d-497b-b6a4-18bcf086ec84 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.101124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e1a90f-2e38-4a32-80ec-ad408c0e872e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.138121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69002dab-8b0a-4ba5-8167-31e3d5c30a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.138760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69002dab-8b0a-4ba5-8167-31e3d5c30a9b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.139058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69002dab-8b0a-4ba5-8167-31e3d5c30a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.139325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69002dab-8b0a-4ba5-8167-31e3d5c30a9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.140438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69002dab-8b0a-4ba5-8167-31e3d5c30a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.141899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69002dab-8b0a-4ba5-8167-31e3d5c30a9b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.143153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.143700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 139/276] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:19.144497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69002dab-8b0a-4ba5-8167-31e3d5c30a9b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.218506 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720cfb4-f46d-497b-b6a4-18bcf086ec84 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.232445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.260725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcbac1-67de-411b-9b1e-3eca7f0fb871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.261443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbac1-67de-411b-9b1e-3eca7f0fb871 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.261696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbac1-67de-411b-9b1e-3eca7f0fb871 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.261970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fcbac1-67de-411b-9b1e-3eca7f0fb871 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.262216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69002dab-8b0a-4ba5-8167-31e3d5c30a9b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.274383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fcbac1-67de-411b-9b1e-3eca7f0fb871 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-16fcbac1-67de-411b-9b1e-3eca7f0fb871 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:19.280029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:19.280929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:19.281821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 138/277] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:19.282498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcbac1-67de-411b-9b1e-3eca7f0fb871 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.300396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0174c-174e-49c4-8996-9e21520534de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.301248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0174c-174e-49c4-8996-9e21520534de None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.301516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0174c-174e-49c4-8996-9e21520534de None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.301776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b0174c-174e-49c4-8996-9e21520534de None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.314350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b0174c-174e-49c4-8996-9e21520534de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d7b0174c-174e-49c4-8996-9e21520534de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:19.319472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:19.320341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:19.321117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:19.323057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 140/278] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:19.327863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0174c-174e-49c4-8996-9e21520534de None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.402691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fcbac1-67de-411b-9b1e-3eca7f0fb871 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.411731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.437441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db1ac5-aebc-455c-80bf-465c7e77bc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.438051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db1ac5-aebc-455c-80bf-465c7e77bc6f None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.438323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db1ac5-aebc-455c-80bf-465c7e77bc6f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.438752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4db1ac5-aebc-455c-80bf-465c7e77bc6f None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.439357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db1ac5-aebc-455c-80bf-465c7e77bc6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.440732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4db1ac5-aebc-455c-80bf-465c7e77bc6f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.441582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b0174c-174e-49c4-8996-9e21520534de None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.465673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 139/279] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:19 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:19.466322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db1ac5-aebc-455c-80bf-465c7e77bc6f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.485802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f9447-97d9-4538-a5b2-3667e2bda29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.487151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9447-97d9-4538-a5b2-3667e2bda29f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.488209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9447-97d9-4538-a5b2-3667e2bda29f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.488751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f9447-97d9-4538-a5b2-3667e2bda29f None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.489914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f9447-97d9-4538-a5b2-3667e2bda29f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:19.490450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f9447-97d9-4538-a5b2-3667e2bda29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.492845 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71f9447-97d9-4538-a5b2-3667e2bda29f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.494843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.507450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 141/280] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:19.513447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f9447-97d9-4538-a5b2-3667e2bda29f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.605495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4db1ac5-aebc-455c-80bf-465c7e77bc6f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.655447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137028a-74dd-4e05-b8c7-577436a1573e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.656413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137028a-74dd-4e05-b8c7-577436a1573e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.656809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f9447-97d9-4538-a5b2-3667e2bda29f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.657132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137028a-74dd-4e05-b8c7-577436a1573e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.657594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137028a-74dd-4e05-b8c7-577436a1573e None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.658455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137028a-74dd-4e05-b8c7-577436a1573e None admin] RBAC: Adding query filter params (name=member) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:19.658994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137028a-74dd-4e05-b8c7-577436a1573e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.661434 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137028a-74dd-4e05-b8c7-577436a1573e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.677062 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 140/281] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:19.678590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137028a-74dd-4e05-b8c7-577436a1573e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.707424 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712e00-80fc-4f10-9dd2-aefc16fc134e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.708087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712e00-80fc-4f10-9dd2-aefc16fc134e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.708367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712e00-80fc-4f10-9dd2-aefc16fc134e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.708646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5712e00-80fc-4f10-9dd2-aefc16fc134e None admin] PATH_INFO: `/v3/users/fe465c9b473e44aea48e8e10afeb472d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.709783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712e00-80fc-4f10-9dd2-aefc16fc134e None admin] RBAC: Authorizing `identity:get_user(user_id=fe465c9b473e44aea48e8e10afeb472d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.711287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5712e00-80fc-4f10-9dd2-aefc16fc134e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.713084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 142/282] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/users/fe465c9b473e44aea48e8e10afeb472d => generated 297 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:19.714222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.718992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712e00-80fc-4f10-9dd2-aefc16fc134e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.805368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:19.809418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137028a-74dd-4e05-b8c7-577436a1573e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.847491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be3f960-4c9f-4bf0-b624-1d01e68fd72d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.847491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3f960-4c9f-4bf0-b624-1d01e68fd72d None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.847811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3f960-4c9f-4bf0-b624-1d01e68fd72d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.848054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3f960-4c9f-4bf0-b624-1d01e68fd72d None admin] PATH_INFO: `/v3/users/d0fe5fb9917147c4ae7a7ff77dbde38e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.858492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5712e00-80fc-4f10-9dd2-aefc16fc134e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:19.868716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3f960-4c9f-4bf0-b624-1d01e68fd72d None admin] RBAC: Authorizing `identity:get_user(user_id=d0fe5fb9917147c4ae7a7ff77dbde38e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.871301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be3f960-4c9f-4bf0-b624-1d01e68fd72d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.873709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 141/283] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/users/d0fe5fb9917147c4ae7a7ff77dbde38e => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:19.875232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2922c8c-674b-45f1-a009-4f12dd96e268 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.875710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2922c8c-674b-45f1-a009-4f12dd96e268 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.876166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2922c8c-674b-45f1-a009-4f12dd96e268 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.877840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 142/284] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:19.881126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2922c8c-674b-45f1-a009-4f12dd96e268 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:19.900652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccfa22-dc82-405c-8250-b887323c2882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:19.901284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccfa22-dc82-405c-8250-b887323c2882 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.901553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccfa22-dc82-405c-8250-b887323c2882 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.901860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccfa22-dc82-405c-8250-b887323c2882 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.903254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccfa22-dc82-405c-8250-b887323c2882 None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:19.904720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccfa22-dc82-405c-8250-b887323c2882 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:19.906843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 143/285] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:19.908105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a293a0-18a8-4019-8123-e3b1567b9e91 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:19.908282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a293a0-18a8-4019-8123-e3b1567b9e91 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:19.908524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a293a0-18a8-4019-8123-e3b1567b9e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:19.927411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-86a293a0-18a8-4019-8123-e3b1567b9e91 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:19.928596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-86a293a0-18a8-4019-8123-e3b1567b9e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:19.986241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:20.004538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2922c8c-674b-45f1-a009-4f12dd96e268 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:20.021842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 144/286] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:20.023332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a293a0-18a8-4019-8123-e3b1567b9e91 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:20.041614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f16134-689e-4e2e-8028-2408d0c5da09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:20.042221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f16134-689e-4e2e-8028-2408d0c5da09 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:20.042586 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f16134-689e-4e2e-8028-2408d0c5da09 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:20.042982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f16134-689e-4e2e-8028-2408d0c5da09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:20.043785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f16134-689e-4e2e-8028-2408d0c5da09 None admin] RBAC: Adding query filter params (role.id=fc85aab66ae3471dbebf6a8340dbd444, user.id=d0fe5fb9917147c4ae7a7ff77dbde38e, scope.system=all) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:20.044106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f16134-689e-4e2e-8028-2408d0c5da09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:20.045721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f16134-689e-4e2e-8028-2408d0c5da09 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:20.054895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 143/287] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Aug 18 20:52:19 2022] GET /identity/v3/role_assignments?user.id=d0fe5fb9917147c4ae7a7ff77dbde38e&scope.system=all&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:20.101210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:20.149941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a293a0-18a8-4019-8123-e3b1567b9e91 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:20.201879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8f7ab-e744-492b-a9cd-4a7197c1032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:20.202465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8f7ab-e744-492b-a9cd-4a7197c1032e None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:20.202740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8f7ab-e744-492b-a9cd-4a7197c1032e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:20.203035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a8f7ab-e744-492b-a9cd-4a7197c1032e None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9/users/fe465c9b473e44aea48e8e10afeb472d/roles/4afb6e1cde9747919b7e855da11806b0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:20.205213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8f7ab-e744-492b-a9cd-4a7197c1032e None admin] RBAC: Authorizing `identity:create_grant(project_id=1e153a5d02af48acaf1b20217342aed9, user_id=fe465c9b473e44aea48e8e10afeb472d, role_id=4afb6e1cde9747919b7e855da11806b0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:20.206711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a8f7ab-e744-492b-a9cd-4a7197c1032e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:20.227032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 145/288] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:20 2022] PUT /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9/users/fe465c9b473e44aea48e8e10afeb472d/roles/4afb6e1cde9747919b7e855da11806b0 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:20.323585 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f16134-689e-4e2e-8028-2408d0c5da09 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:20.442039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f16134-689e-4e2e-8028-2408d0c5da09 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:20.478324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fc428-a317-4091-a329-0c99fcde1022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:20.478997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc428-a317-4091-a329-0c99fcde1022 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:20.479272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc428-a317-4091-a329-0c99fcde1022 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:20.479537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2fc428-a317-4091-a329-0c99fcde1022 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:20.490498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2fc428-a317-4091-a329-0c99fcde1022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-bc2fc428-a317-4091-a329-0c99fcde1022 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:20.495260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:20.497018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:20.497990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 144/289] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:20.502607 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8f7ab-e744-492b-a9cd-4a7197c1032e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:20.607751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a8f7ab-e744-492b-a9cd-4a7197c1032e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:20.638762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:20.652718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c69b4c-3547-4f2d-af93-9acbe019927d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:20.653299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c69b4c-3547-4f2d-af93-9acbe019927d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:20.653633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c69b4c-3547-4f2d-af93-9acbe019927d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:20.654111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c69b4c-3547-4f2d-af93-9acbe019927d None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:20.654806 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c69b4c-3547-4f2d-af93-9acbe019927d None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:20.655109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c69b4c-3547-4f2d-af93-9acbe019927d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:20.656482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c69b4c-3547-4f2d-af93-9acbe019927d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:20.669628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 146/290] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:20.674848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fc428-a317-4091-a329-0c99fcde1022 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:20.688443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:20.800791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2fc428-a317-4091-a329-0c99fcde1022 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:20.836797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb6a06-c036-4c8f-ba71-8cf6a0109253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:20.837433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb6a06-c036-4c8f-ba71-8cf6a0109253 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:20.837710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb6a06-c036-4c8f-ba71-8cf6a0109253 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:20.837979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb6a06-c036-4c8f-ba71-8cf6a0109253 None admin] PATH_INFO: `/v3/users/1d811ddb331f478baec4c3484649a8df` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:20.839138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb6a06-c036-4c8f-ba71-8cf6a0109253 None admin] RBAC: Authorizing `identity:get_user(user_id=1d811ddb331f478baec4c3484649a8df)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:20.840908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb6a06-c036-4c8f-ba71-8cf6a0109253 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:20.842798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 145/291] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:20 2022] GET /identity/v3/users/1d811ddb331f478baec4c3484649a8df => generated 297 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:20.851905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c69b4c-3547-4f2d-af93-9acbe019927d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:20.962623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c69b4c-3547-4f2d-af93-9acbe019927d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:20.999490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ee304-f8ed-4700-b9ee-5af0ff06a5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:21.000459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ee304-f8ed-4700-b9ee-5af0ff06a5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:21.000934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ee304-f8ed-4700-b9ee-5af0ff06a5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:21.001399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1ee304-f8ed-4700-b9ee-5af0ff06a5f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:21.108870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:21.142101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ee304-f8ed-4700-b9ee-5af0ff06a5f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:21.144881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1ee304-f8ed-4700-b9ee-5af0ff06a5f6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:21.330439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 147/292] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:21.337244 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb6a06-c036-4c8f-ba71-8cf6a0109253 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:21.437815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:21.465558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb6a06-c036-4c8f-ba71-8cf6a0109253 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:21.499973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6efefb-0980-4bae-83d5-093f2101cc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:21.500617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6efefb-0980-4bae-83d5-093f2101cc30 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:21.500891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6efefb-0980-4bae-83d5-093f2101cc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:21.501162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6efefb-0980-4bae-83d5-093f2101cc30 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:21.502288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6efefb-0980-4bae-83d5-093f2101cc30 None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:21.503773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6efefb-0980-4bae-83d5-093f2101cc30 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:21.505726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 146/293] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:21 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:21.511504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ee304-f8ed-4700-b9ee-5af0ff06a5f6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:21.615908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:21.641513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1ee304-f8ed-4700-b9ee-5af0ff06a5f6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:21.688570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2714b4ec-82b3-4543-bc8c-d7a6e33de303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:21.689106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714b4ec-82b3-4543-bc8c-d7a6e33de303 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:21.689382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714b4ec-82b3-4543-bc8c-d7a6e33de303 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:21.689654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2714b4ec-82b3-4543-bc8c-d7a6e33de303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:21.690385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714b4ec-82b3-4543-bc8c-d7a6e33de303 None admin] RBAC: Adding query filter params (role.id=fc85aab66ae3471dbebf6a8340dbd444, scope.project.id=1e153a5d02af48acaf1b20217342aed9, user.id=1d811ddb331f478baec4c3484649a8df) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:21.690691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714b4ec-82b3-4543-bc8c-d7a6e33de303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:21.692164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2714b4ec-82b3-4543-bc8c-d7a6e33de303 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:21.703181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 148/294] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:21 2022] GET /identity/v3/role_assignments?user.id=1d811ddb331f478baec4c3484649a8df&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:21.856403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02583b0-f50d-434d-b1ed-3809eda9cd92 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:21.856730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02583b0-f50d-434d-b1ed-3809eda9cd92 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:21.856953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02583b0-f50d-434d-b1ed-3809eda9cd92 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:21.858487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 147/295] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:21.863976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138971d-0b8c-497e-adcf-77c80bf5409a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:21.864257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138971d-0b8c-497e-adcf-77c80bf5409a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:21.864531 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138971d-0b8c-497e-adcf-77c80bf5409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:21.884466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b138971d-0b8c-497e-adcf-77c80bf5409a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:21.886046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b138971d-0b8c-497e-adcf-77c80bf5409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:21.958426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 149/296] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:22.247095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02583b0-f50d-434d-b1ed-3809eda9cd92 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:22.363718 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02583b0-f50d-434d-b1ed-3809eda9cd92 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:22.404351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ece7975-0160-4e20-bdb1-aa2ec4851a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:22.405000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece7975-0160-4e20-bdb1-aa2ec4851a63 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.405274 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece7975-0160-4e20-bdb1-aa2ec4851a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.405541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ece7975-0160-4e20-bdb1-aa2ec4851a63 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.416355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ece7975-0160-4e20-bdb1-aa2ec4851a63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-2ece7975-0160-4e20-bdb1-aa2ec4851a63 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:22.421496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:22.422369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:22.423175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 148/297] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:22.428443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138971d-0b8c-497e-adcf-77c80bf5409a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:22.429952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b3c1-4224-41ba-b979-5ed8c515cea7 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.430230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b3c1-4224-41ba-b979-5ed8c515cea7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.430499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f32b3c1-4224-41ba-b979-5ed8c515cea7 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.432339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 149/298] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:22.439329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd5fec-9ed8-4b60-842b-07234208a26b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.439612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd5fec-9ed8-4b60-842b-07234208a26b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.439888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accd5fec-9ed8-4b60-842b-07234208a26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.450408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:22.464205 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-accd5fec-9ed8-4b60-842b-07234208a26b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:22.465559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-accd5fec-9ed8-4b60-842b-07234208a26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:22.518558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:22.539450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138971d-0b8c-497e-adcf-77c80bf5409a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:22.554331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 150/299] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:22.555905 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505756c-8fc5-4680-bccf-70ea6577af7d None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.556249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505756c-8fc5-4680-bccf-70ea6577af7d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.556524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6505756c-8fc5-4680-bccf-70ea6577af7d None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.557789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 151/300] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:22.569994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44306-318b-4a69-8b5c-3b34be9328e7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.570658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44306-318b-4a69-8b5c-3b34be9328e7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.571318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa44306-318b-4a69-8b5c-3b34be9328e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.582140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1aecd-f476-4d14-95d5-af5f44ac6cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:22.583120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1aecd-f476-4d14-95d5-af5f44ac6cfc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.583575 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1aecd-f476-4d14-95d5-af5f44ac6cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.584018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b1aecd-f476-4d14-95d5-af5f44ac6cfc None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.584872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1aecd-f476-4d14-95d5-af5f44ac6cfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:22.585365 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1aecd-f476-4d14-95d5-af5f44ac6cfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:22.586994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b1aecd-f476-4d14-95d5-af5f44ac6cfc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:22.595907 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-0fa44306-318b-4a69-8b5c-3b34be9328e7 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:22.597071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 150/301] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:22.597497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0fa44306-318b-4a69-8b5c-3b34be9328e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:22.603512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1aecd-f476-4d14-95d5-af5f44ac6cfc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:22.687714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 152/302] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:22.695191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbc078-e6db-4c8f-ae32-4db791ed6cee None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.695191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbc078-e6db-4c8f-ae32-4db791ed6cee None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.695191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbc078-e6db-4c8f-ae32-4db791ed6cee None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.697907 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 153/303] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:22.699046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79a77-f4c5-4bf2-9c79-53e137eaea52 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.699332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79a77-f4c5-4bf2-9c79-53e137eaea52 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.699699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc79a77-f4c5-4bf2-9c79-53e137eaea52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.717370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7fc79a77-f4c5-4bf2-9c79-53e137eaea52 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:22.718561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7fc79a77-f4c5-4bf2-9c79-53e137eaea52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:22.728539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b1aecd-f476-4d14-95d5-af5f44ac6cfc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:22.778278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95299b77-99b3-47eb-8d83-5435d8ca00b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:22.779294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95299b77-99b3-47eb-8d83-5435d8ca00b1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.779768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95299b77-99b3-47eb-8d83-5435d8ca00b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.780211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95299b77-99b3-47eb-8d83-5435d8ca00b1 None admin] PATH_INFO: `/v3/users/ebc1e279281f4c53924e7b9449ace048` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.781317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:22.789754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 154/304] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:22.801984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:22.806247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95299b77-99b3-47eb-8d83-5435d8ca00b1 None admin] RBAC: Authorizing `identity:get_user(user_id=ebc1e279281f4c53924e7b9449ace048)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:22.808049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95299b77-99b3-47eb-8d83-5435d8ca00b1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:22.810059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 151/305] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:22 2022] GET /identity/v3/users/ebc1e279281f4c53924e7b9449ace048 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:22.820102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc79a77-f4c5-4bf2-9c79-53e137eaea52 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:22.823589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95299b77-99b3-47eb-8d83-5435d8ca00b1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:22.927269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc79a77-f4c5-4bf2-9c79-53e137eaea52 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:22.948513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95299b77-99b3-47eb-8d83-5435d8ca00b1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:22.971123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bca0a-ff61-4e55-9aa0-42ce6e517495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:22.972249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bca0a-ff61-4e55-9aa0-42ce6e517495 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.973085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bca0a-ff61-4e55-9aa0-42ce6e517495 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.973779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6bca0a-ff61-4e55-9aa0-42ce6e517495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.974968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bca0a-ff61-4e55-9aa0-42ce6e517495 None admin] RBAC: Adding query filter params (role.id=4afb6e1cde9747919b7e855da11806b0, user.id=ebc1e279281f4c53924e7b9449ace048, scope.system=all) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:22.975805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bca0a-ff61-4e55-9aa0-42ce6e517495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:22.977965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6bca0a-ff61-4e55-9aa0-42ce6e517495 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:22.984016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf31ed5-c525-49e3-ba81-9ab60802f6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:22.984649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf31ed5-c525-49e3-ba81-9ab60802f6bb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:22.984928 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf31ed5-c525-49e3-ba81-9ab60802f6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:22.985202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf31ed5-c525-49e3-ba81-9ab60802f6bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:22.985765 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 155/306] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Aug 18 20:52:22 2022] GET /identity/v3/role_assignments?user.id=ebc1e279281f4c53924e7b9449ace048&scope.system=all&role.id=4afb6e1cde9747919b7e855da11806b0 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:22.986354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf31ed5-c525-49e3-ba81-9ab60802f6bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:22.987837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf31ed5-c525-49e3-ba81-9ab60802f6bb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:22.989562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 152/307] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:22.990481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bca0a-ff61-4e55-9aa0-42ce6e517495 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.000292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf31ed5-c525-49e3-ba81-9ab60802f6bb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.075783 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:23.078623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:23.122035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf31ed5-c525-49e3-ba81-9ab60802f6bb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.123146 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6bca0a-ff61-4e55-9aa0-42ce6e517495 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.161851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d496f6b-43e3-4ded-83f4-d7b3f366b94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.162634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d496f6b-43e3-4ded-83f4-d7b3f366b94c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.162759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c57fb-d57e-4189-87a5-aae1c22d0816 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.163002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d496f6b-43e3-4ded-83f4-d7b3f366b94c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.163215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d496f6b-43e3-4ded-83f4-d7b3f366b94c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.163309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c57fb-d57e-4189-87a5-aae1c22d0816 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.163577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c57fb-d57e-4189-87a5-aae1c22d0816 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.163849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c57fb-d57e-4189-87a5-aae1c22d0816 None admin] PATH_INFO: `/v3/groups` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.164472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c57fb-d57e-4189-87a5-aae1c22d0816 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.165918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c57fb-d57e-4189-87a5-aae1c22d0816 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.174724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d496f6b-43e3-4ded-83f4-d7b3f366b94c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-2d496f6b-43e3-4ded-83f4-d7b3f366b94c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:23.181106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:23.182061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:23.182869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 156/308] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:23.183809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d496f6b-43e3-4ded-83f4-d7b3f366b94c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.190828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 153/309] 10.222.0.59 () {60 vars in 1134 bytes} [Thu Aug 18 20:52:22 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:23.191654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c57fb-d57e-4189-87a5-aae1c22d0816 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.316860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d496f6b-43e3-4ded-83f4-d7b3f366b94c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.326503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c57fb-d57e-4189-87a5-aae1c22d0816 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.338451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:23.361180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:23.363488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fe8ea-f62c-4ae4-8029-4ef6487e2d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.364382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe8ea-f62c-4ae4-8029-4ef6487e2d73 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.364924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe8ea-f62c-4ae4-8029-4ef6487e2d73 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.364924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5fe8ea-f62c-4ae4-8029-4ef6487e2d73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.373744 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2ffc-ca60-406b-bfa2-cbe0f593a1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.374404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2ffc-ca60-406b-bfa2-cbe0f593a1ed None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.375395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2ffc-ca60-406b-bfa2-cbe0f593a1ed None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.375395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e2ffc-ca60-406b-bfa2-cbe0f593a1ed None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.375699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2ffc-ca60-406b-bfa2-cbe0f593a1ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:23.376000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2ffc-ca60-406b-bfa2-cbe0f593a1ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.377708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e2ffc-ca60-406b-bfa2-cbe0f593a1ed None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.388407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5fe8ea-f62c-4ae4-8029-4ef6487e2d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:23.393585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 154/310] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-8d5fe8ea-f62c-4ae4-8029-4ef6487e2d73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:23.393789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:23.395790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:23.396908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 157/311] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:23.402820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2ffc-ca60-406b-bfa2-cbe0f593a1ed None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.407264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fe8ea-f62c-4ae4-8029-4ef6487e2d73 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.531892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e2ffc-ca60-406b-bfa2-cbe0f593a1ed None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.535209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5fe8ea-f62c-4ae4-8029-4ef6487e2d73 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.569379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d380f6d-6faa-4c4f-a25e-ddc92490ac54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.570081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d380f6d-6faa-4c4f-a25e-ddc92490ac54 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.570359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d380f6d-6faa-4c4f-a25e-ddc92490ac54 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.570684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d380f6d-6faa-4c4f-a25e-ddc92490ac54 None admin] PATH_INFO: `/v3/users/d0fe5fb9917147c4ae7a7ff77dbde38e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.571841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d380f6d-6faa-4c4f-a25e-ddc92490ac54 None admin] RBAC: Authorizing `identity:get_user(user_id=d0fe5fb9917147c4ae7a7ff77dbde38e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.573336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d380f6d-6faa-4c4f-a25e-ddc92490ac54 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.575363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 155/312] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:23 2022] GET /identity/v3/users/d0fe5fb9917147c4ae7a7ff77dbde38e => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:23.580186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6ddef-a70f-4d12-92a2-eb68e81ca553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.580915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d380f6d-6faa-4c4f-a25e-ddc92490ac54 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.581272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6ddef-a70f-4d12-92a2-eb68e81ca553 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.581754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6ddef-a70f-4d12-92a2-eb68e81ca553 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.582216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f6ddef-a70f-4d12-92a2-eb68e81ca553 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.583105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6ddef-a70f-4d12-92a2-eb68e81ca553 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:23.583779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6ddef-a70f-4d12-92a2-eb68e81ca553 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.586249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73f6ddef-a70f-4d12-92a2-eb68e81ca553 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.597379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 158/313] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:23.602439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6ddef-a70f-4d12-92a2-eb68e81ca553 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.656389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:23.658313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:23.704975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d380f6d-6faa-4c4f-a25e-ddc92490ac54 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.719622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f6ddef-a70f-4d12-92a2-eb68e81ca553 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.749103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d2c6-7a33-49e6-bedf-07db5a7ffdc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.749759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d2c6-7a33-49e6-bedf-07db5a7ffdc6 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.750278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d2c6-7a33-49e6-bedf-07db5a7ffdc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.750560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0304d2c6-7a33-49e6-bedf-07db5a7ffdc6 None admin] PATH_INFO: `/v3/system/users/d0fe5fb9917147c4ae7a7ff77dbde38e/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.752253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304d2c6-7a33-49e6-bedf-07db5a7ffdc6 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=d0fe5fb9917147c4ae7a7ff77dbde38e, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.754312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0304d2c6-7a33-49e6-bedf-07db5a7ffdc6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.760427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd66fc-55bf-4bae-9647-fcb76cb7bd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.761498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd66fc-55bf-4bae-9647-fcb76cb7bd52 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.762099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd66fc-55bf-4bae-9647-fcb76cb7bd52 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.762619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd66fc-55bf-4bae-9647-fcb76cb7bd52 None admin] PATH_INFO: `/v3/users/fe465c9b473e44aea48e8e10afeb472d` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:23.764023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd66fc-55bf-4bae-9647-fcb76cb7bd52 None admin] RBAC: Authorizing `identity:get_user(user_id=fe465c9b473e44aea48e8e10afeb472d)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:23.765759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd66fc-55bf-4bae-9647-fcb76cb7bd52 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:23.772409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 159/314] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:23 2022] GET /identity/v3/users/fe465c9b473e44aea48e8e10afeb472d => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:23.773628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 156/315] 10.222.0.59 () {58 vars in 1334 bytes} [Thu Aug 18 20:52:23 2022] PUT /identity/v3/system/users/d0fe5fb9917147c4ae7a7ff77dbde38e/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:23.774700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd66fc-55bf-4bae-9647-fcb76cb7bd52 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:23.897032 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd66fc-55bf-4bae-9647-fcb76cb7bd52 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:23.907375 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:23.935164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1d0f4-90b8-4dab-a166-16fb60fad20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:23.935799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1d0f4-90b8-4dab-a166-16fb60fad20b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:23.936062 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1d0f4-90b8-4dab-a166-16fb60fad20b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:23.936330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1d0f4-90b8-4dab-a166-16fb60fad20b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:24.009393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1d0f4-90b8-4dab-a166-16fb60fad20b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:24.011621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa1d0f4-90b8-4dab-a166-16fb60fad20b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:24.117844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 160/316] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:24.124219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d2c6-7a33-49e6-bedf-07db5a7ffdc6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:24.230691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0304d2c6-7a33-49e6-bedf-07db5a7ffdc6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:24.251225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:24.268546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a2e448-9bad-4b3d-ba1d-7b63e8b1a6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:24.269182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e448-9bad-4b3d-ba1d-7b63e8b1a6fd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:24.269456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e448-9bad-4b3d-ba1d-7b63e8b1a6fd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:24.269722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a2e448-9bad-4b3d-ba1d-7b63e8b1a6fd None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:24.270857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2e448-9bad-4b3d-ba1d-7b63e8b1a6fd None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:24.272609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a2e448-9bad-4b3d-ba1d-7b63e8b1a6fd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:24.274654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 157/317] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:24 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:24.280675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1d0f4-90b8-4dab-a166-16fb60fad20b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:24.291639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:24.390076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1d0f4-90b8-4dab-a166-16fb60fad20b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:24.427123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ad013-8b1c-4ef5-8419-61be42504fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:24.428159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ad013-8b1c-4ef5-8419-61be42504fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:24.428625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ad013-8b1c-4ef5-8419-61be42504fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:24.429106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ad013-8b1c-4ef5-8419-61be42504fe7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:24.430020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ad013-8b1c-4ef5-8419-61be42504fe7 None admin] RBAC: Adding query filter params (role.id=4afb6e1cde9747919b7e855da11806b0, scope.project.id=1e153a5d02af48acaf1b20217342aed9, user.id=fe465c9b473e44aea48e8e10afeb472d) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:24.430547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ad013-8b1c-4ef5-8419-61be42504fe7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:24.432206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ad013-8b1c-4ef5-8419-61be42504fe7 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:24.439340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 161/318] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:24 2022] GET /identity/v3/role_assignments?user.id=fe465c9b473e44aea48e8e10afeb472d&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=4afb6e1cde9747919b7e855da11806b0 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:24.907328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbeff2f-29b7-463e-a8d7-1c97ba6a25d8 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:24.907849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbeff2f-29b7-463e-a8d7-1c97ba6a25d8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:24.907849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbeff2f-29b7-463e-a8d7-1c97ba6a25d8 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:24.909190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 158/319] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:24.914567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc594-4f94-475b-9e05-4a0ff68fd85b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:24.914891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc594-4f94-475b-9e05-4a0ff68fd85b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:24.915125 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2bc594-4f94-475b-9e05-4a0ff68fd85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:24.934437 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-bf2bc594-4f94-475b-9e05-4a0ff68fd85b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:24.935644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-bf2bc594-4f94-475b-9e05-4a0ff68fd85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:25.005995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 162/320] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:25.207886 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6b926-f116-43ba-bfe4-abd02521196b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:25.208065 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6b926-f116-43ba-bfe4-abd02521196b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:25.208334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c6b926-f116-43ba-bfe4-abd02521196b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:25.209828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 159/321] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:25.215153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993e3a-18df-478b-8846-0aa4ae1a9cc4 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:25.215459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993e3a-18df-478b-8846-0aa4ae1a9cc4 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:25.215731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3993e3a-18df-478b-8846-0aa4ae1a9cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:25.222137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:25.236011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-a3993e3a-18df-478b-8846-0aa4ae1a9cc4 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:25.237183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a3993e3a-18df-478b-8846-0aa4ae1a9cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:25.271839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6b926-f116-43ba-bfe4-abd02521196b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:25.306762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 163/322] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:25.388334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c6b926-f116-43ba-bfe4-abd02521196b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:25.424909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae89da-2a78-4261-af0a-e657d623ce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:25.424909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae89da-2a78-4261-af0a-e657d623ce35 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:25.425171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae89da-2a78-4261-af0a-e657d623ce35 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:25.425417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae89da-2a78-4261-af0a-e657d623ce35 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:25.436525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae89da-2a78-4261-af0a-e657d623ce35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-77ae89da-2a78-4261-af0a-e657d623ce35 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:25.441844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:25.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:25.443532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:25.447083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 160/323] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:25.448775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993e3a-18df-478b-8846-0aa4ae1a9cc4 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:25.550409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3993e3a-18df-478b-8846-0aa4ae1a9cc4 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:25.579112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae89da-2a78-4261-af0a-e657d623ce35 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:25.581035 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:25.587805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67118586-3b9b-4705-a2ad-0fe81c1cdd21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:25.588418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67118586-3b9b-4705-a2ad-0fe81c1cdd21 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:25.588693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67118586-3b9b-4705-a2ad-0fe81c1cdd21 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:25.588960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67118586-3b9b-4705-a2ad-0fe81c1cdd21 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:25.589798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67118586-3b9b-4705-a2ad-0fe81c1cdd21 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:25.590101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67118586-3b9b-4705-a2ad-0fe81c1cdd21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:25.591998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67118586-3b9b-4705-a2ad-0fe81c1cdd21 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:25.601073 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 164/324] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:25.606422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67118586-3b9b-4705-a2ad-0fe81c1cdd21 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:25.642693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:25.699921 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae89da-2a78-4261-af0a-e657d623ce35 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:25.714763 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67118586-3b9b-4705-a2ad-0fe81c1cdd21 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:25.735326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598b447-c9de-4fed-8e66-9430e177f121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:25.735992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598b447-c9de-4fed-8e66-9430e177f121 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:25.736270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598b447-c9de-4fed-8e66-9430e177f121 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:25.736538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6598b447-c9de-4fed-8e66-9430e177f121 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:25.737691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598b447-c9de-4fed-8e66-9430e177f121 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:25.739184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6598b447-c9de-4fed-8e66-9430e177f121 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:25.740762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 161/325] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:25.746367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598b447-c9de-4fed-8e66-9430e177f121 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:25.754274 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d14ae76-42ac-4a65-bac0-86b4dc9aac42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:25.754948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14ae76-42ac-4a65-bac0-86b4dc9aac42 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:25.757730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14ae76-42ac-4a65-bac0-86b4dc9aac42 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:25.757730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d14ae76-42ac-4a65-bac0-86b4dc9aac42 None admin] PATH_INFO: `/v3/users/ebc1e279281f4c53924e7b9449ace048` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:25.758891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14ae76-42ac-4a65-bac0-86b4dc9aac42 None admin] RBAC: Authorizing `identity:get_user(user_id=ebc1e279281f4c53924e7b9449ace048)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:25.760346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d14ae76-42ac-4a65-bac0-86b4dc9aac42 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:25.766696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 165/326] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:25 2022] GET /identity/v3/users/ebc1e279281f4c53924e7b9449ace048 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:25.766696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808825-6267-40b3-b0ca-647c5b4f302f None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:25.766696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808825-6267-40b3-b0ca-647c5b4f302f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:25.766696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3808825-6267-40b3-b0ca-647c5b4f302f None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:25.766696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 166/327] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:25.767658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3808825-6267-40b3-b0ca-647c5b4f302f None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:25.830863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:25.859035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6598b447-c9de-4fed-8e66-9430e177f121 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:25.871870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3808825-6267-40b3-b0ca-647c5b4f302f None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:25.876257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:25.895000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88890dd-e281-4c38-9c06-0ea050689c16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:25.895609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88890dd-e281-4c38-9c06-0ea050689c16 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:25.895859 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88890dd-e281-4c38-9c06-0ea050689c16 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:25.896478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88890dd-e281-4c38-9c06-0ea050689c16 None admin] PATH_INFO: `/v3/groups` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:25.897112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88890dd-e281-4c38-9c06-0ea050689c16 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:25.898545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88890dd-e281-4c38-9c06-0ea050689c16 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:25.908355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dad23-4073-4b11-9b03-81db871a6d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:25.909006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dad23-4073-4b11-9b03-81db871a6d29 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:25.909281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dad23-4073-4b11-9b03-81db871a6d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:25.909578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dad23-4073-4b11-9b03-81db871a6d29 None admin] PATH_INFO: `/v3/system/users/ebc1e279281f4c53924e7b9449ace048/roles/4afb6e1cde9747919b7e855da11806b0` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:25.911022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dad23-4073-4b11-9b03-81db871a6d29 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ebc1e279281f4c53924e7b9449ace048, role_id=4afb6e1cde9747919b7e855da11806b0)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:25.912381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dad23-4073-4b11-9b03-81db871a6d29 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:25.914039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 162/328] 10.222.0.59 () {60 vars in 1134 bytes} [Thu Aug 18 20:52:25 2022] POST /identity/v3/groups => generated 226 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:25.915093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6c9cd-c60e-416e-b24a-68dc06ff4d0b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:25.915397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6c9cd-c60e-416e-b24a-68dc06ff4d0b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:25.915656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf6c9cd-c60e-416e-b24a-68dc06ff4d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:25.929226 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 167/329] 10.222.0.59 () {58 vars in 1334 bytes} [Thu Aug 18 20:52:25 2022] PUT /identity/v3/system/users/ebc1e279281f4c53924e7b9449ace048/roles/4afb6e1cde9747919b7e855da11806b0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:25.941200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dbf6c9cd-c60e-416e-b24a-68dc06ff4d0b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:25.942619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dbf6c9cd-c60e-416e-b24a-68dc06ff4d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:26.026280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 163/330] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:26.293796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dad23-4073-4b11-9b03-81db871a6d29 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:26.423186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dad23-4073-4b11-9b03-81db871a6d29 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:26.452985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:26.465863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd2c1c-4395-4f8f-b5b7-193c7430b11d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:26.466686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd2c1c-4395-4f8f-b5b7-193c7430b11d None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:26.467370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd2c1c-4395-4f8f-b5b7-193c7430b11d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:26.467994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cd2c1c-4395-4f8f-b5b7-193c7430b11d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:26.481030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76cd2c1c-4395-4f8f-b5b7-193c7430b11d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-76cd2c1c-4395-4f8f-b5b7-193c7430b11d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:26.485861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:26.486729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:26.487568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 168/331] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:26.493967 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6c9cd-c60e-416e-b24a-68dc06ff4d0b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:26.612301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf6c9cd-c60e-416e-b24a-68dc06ff4d0b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:26.620011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:26.653600 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33652b-e7eb-45a6-9f3f-c913e363acff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:26.654573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33652b-e7eb-45a6-9f3f-c913e363acff None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:26.655171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33652b-e7eb-45a6-9f3f-c913e363acff None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:26.655759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33652b-e7eb-45a6-9f3f-c913e363acff None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:26.656449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33652b-e7eb-45a6-9f3f-c913e363acff None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:26.656752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33652b-e7eb-45a6-9f3f-c913e363acff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:26.658163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b33652b-e7eb-45a6-9f3f-c913e363acff None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:26.668054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 164/332] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:26.676197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd2c1c-4395-4f8f-b5b7-193c7430b11d None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:26.797480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cd2c1c-4395-4f8f-b5b7-193c7430b11d None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:26.843913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322bc02b-c5b9-4b70-9c1f-6bca0917fc99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:26.844681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc02b-c5b9-4b70-9c1f-6bca0917fc99 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:26.844960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc02b-c5b9-4b70-9c1f-6bca0917fc99 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:26.845231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322bc02b-c5b9-4b70-9c1f-6bca0917fc99 None admin] PATH_INFO: `/v3/users/d0fe5fb9917147c4ae7a7ff77dbde38e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:26.846373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bc02b-c5b9-4b70-9c1f-6bca0917fc99 None admin] RBAC: Authorizing `identity:get_user(user_id=d0fe5fb9917147c4ae7a7ff77dbde38e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:26.847871 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322bc02b-c5b9-4b70-9c1f-6bca0917fc99 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:26.849567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 169/333] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:26 2022] GET /identity/v3/users/d0fe5fb9917147c4ae7a7ff77dbde38e => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:26.856544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33652b-e7eb-45a6-9f3f-c913e363acff None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:26.972692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33652b-e7eb-45a6-9f3f-c913e363acff None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:27.018245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74613d63-d857-4648-a624-8234f5a05b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:27.018880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74613d63-d857-4648-a624-8234f5a05b50 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:27.019156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74613d63-d857-4648-a624-8234f5a05b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:27.019423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74613d63-d857-4648-a624-8234f5a05b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:27.020154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74613d63-d857-4648-a624-8234f5a05b50 None admin] RBAC: Adding query filter params (role.id=fc85aab66ae3471dbebf6a8340dbd444, user.id=d0fe5fb9917147c4ae7a7ff77dbde38e, scope.system=all) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:27.020453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74613d63-d857-4648-a624-8234f5a05b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:27.022204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74613d63-d857-4648-a624-8234f5a05b50 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:27.042947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 165/334] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Aug 18 20:52:26 2022] GET /identity/v3/role_assignments?user.id=d0fe5fb9917147c4ae7a7ff77dbde38e&scope.system=all&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:28.153994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e01b8-7016-4d15-9f80-b18e977083ae None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:28.154743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e01b8-7016-4d15-9f80-b18e977083ae None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:28.154743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e01b8-7016-4d15-9f80-b18e977083ae None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:28.155899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 170/335] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:28.161707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8448533-184d-4015-93a4-706bf86fee93 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:28.162228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8448533-184d-4015-93a4-706bf86fee93 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:28.162228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8448533-184d-4015-93a4-706bf86fee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:28.183913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b8448533-184d-4015-93a4-706bf86fee93 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:28.185116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b8448533-184d-4015-93a4-706bf86fee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:28.209057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:28.273328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 166/336] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:28.359841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80441cc3-e2e7-433d-89df-f1c2206bb190 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:28.360180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80441cc3-e2e7-433d-89df-f1c2206bb190 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:28.360387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80441cc3-e2e7-433d-89df-f1c2206bb190 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:28.361888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 171/337] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:28.367484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc182ca9-0feb-4164-976f-99a23c3834c1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:28.367770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc182ca9-0feb-4164-976f-99a23c3834c1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:28.368043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc182ca9-0feb-4164-976f-99a23c3834c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:28.378176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a64a43-9f77-4231-a24a-f0484be95714 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:28.378473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a64a43-9f77-4231-a24a-f0484be95714 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:28.378724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a64a43-9f77-4231-a24a-f0484be95714 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:28.380251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 172/338] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:28.385343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe148ea-bb93-47c4-8690-0520f163800c None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:28.385882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe148ea-bb93-47c4-8690-0520f163800c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:28.386435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe148ea-bb93-47c4-8690-0520f163800c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:28.390393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bc182ca9-0feb-4164-976f-99a23c3834c1 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:28.391620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bc182ca9-0feb-4164-976f-99a23c3834c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:28.415865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-abe148ea-bb93-47c4-8690-0520f163800c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:28.417493 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-abe148ea-bb93-47c4-8690-0520f163800c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:28.489910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 167/339] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:28.509465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:28.543906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 173/340] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:28.921547 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc182ca9-0feb-4164-976f-99a23c3834c1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:28.978294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe148ea-bb93-47c4-8690-0520f163800c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.048244 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:29.069266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc182ca9-0feb-4164-976f-99a23c3834c1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.125303 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86e40a-01e6-484b-962d-fdca696df3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.125956 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86e40a-01e6-484b-962d-fdca696df3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.126233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86e40a-01e6-484b-962d-fdca696df3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.126597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d86e40a-01e6-484b-962d-fdca696df3f4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.159112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d86e40a-01e6-484b-962d-fdca696df3f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8d86e40a-01e6-484b-962d-fdca696df3f4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:29.166487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:29.168075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 18 20:52:29.169033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:29.170288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 168/341] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:29.175873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86e40a-01e6-484b-962d-fdca696df3f4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.213707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe148ea-bb93-47c4-8690-0520f163800c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.280568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e291193-b7d6-45bf-b8c9-0797adea3af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.281594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e291193-b7d6-45bf-b8c9-0797adea3af4 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.282065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e291193-b7d6-45bf-b8c9-0797adea3af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.282524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e291193-b7d6-45bf-b8c9-0797adea3af4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.311803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e291193-b7d6-45bf-b8c9-0797adea3af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-6e291193-b7d6-45bf-b8c9-0797adea3af4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:29.316954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:29.317839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:29.318627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:29.319726 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d86e40a-01e6-484b-962d-fdca696df3f4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.326977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 174/342] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:29.328288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e291193-b7d6-45bf-b8c9-0797adea3af4 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.368568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0335a0-d35f-4ae3-a2db-1f2b01e350e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.369844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0335a0-d35f-4ae3-a2db-1f2b01e350e4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.370332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0335a0-d35f-4ae3-a2db-1f2b01e350e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.370671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0335a0-d35f-4ae3-a2db-1f2b01e350e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.372756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0335a0-d35f-4ae3-a2db-1f2b01e350e4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:29.373062 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0335a0-d35f-4ae3-a2db-1f2b01e350e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.374710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0335a0-d35f-4ae3-a2db-1f2b01e350e4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.385905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 169/343] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:29.386700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0335a0-d35f-4ae3-a2db-1f2b01e350e4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.404772 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:29.409216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:29.473131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e291193-b7d6-45bf-b8c9-0797adea3af4 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.503961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0335a0-d35f-4ae3-a2db-1f2b01e350e4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.515135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa231cdf-693e-46e1-a489-3917174c62a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.515889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa231cdf-693e-46e1-a489-3917174c62a2 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.516173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa231cdf-693e-46e1-a489-3917174c62a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.516447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa231cdf-693e-46e1-a489-3917174c62a2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.529370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa231cdf-693e-46e1-a489-3917174c62a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-fa231cdf-693e-46e1-a489-3917174c62a2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:29.534643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:29.535576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:29.536785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 175/344] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:29.537545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25675f7d-7426-473d-be24-04a99f43d0b8 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.537545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25675f7d-7426-473d-be24-04a99f43d0b8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.537980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25675f7d-7426-473d-be24-04a99f43d0b8 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.539142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 176/345] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:29.539785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25675f7d-7426-473d-be24-04a99f43d0b8 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.547638 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9144dac-a8fd-43b0-8dc5-390470d08fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.549215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9144dac-a8fd-43b0-8dc5-390470d08fe4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.549495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9144dac-a8fd-43b0-8dc5-390470d08fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.549769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9144dac-a8fd-43b0-8dc5-390470d08fe4 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.550468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9144dac-a8fd-43b0-8dc5-390470d08fe4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:29.550793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9144dac-a8fd-43b0-8dc5-390470d08fe4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.552189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9144dac-a8fd-43b0-8dc5-390470d08fe4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.564432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 170/346] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:29.565610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9144dac-a8fd-43b0-8dc5-390470d08fe4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.665053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:29.692138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25675f7d-7426-473d-be24-04a99f43d0b8 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.695637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:29.710312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9144dac-a8fd-43b0-8dc5-390470d08fe4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.740998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1640e9-b21d-4d57-b92a-76a6ecb1a12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.741743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1640e9-b21d-4d57-b92a-76a6ecb1a12f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.742025 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1640e9-b21d-4d57-b92a-76a6ecb1a12f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.742398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1640e9-b21d-4d57-b92a-76a6ecb1a12f None admin] PATH_INFO: `/v3/users/ebc1e279281f4c53924e7b9449ace048` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.743791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1640e9-b21d-4d57-b92a-76a6ecb1a12f None admin] RBAC: Authorizing `identity:get_user(user_id=ebc1e279281f4c53924e7b9449ace048)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.745206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1640e9-b21d-4d57-b92a-76a6ecb1a12f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.747385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28312d3e-a432-4fae-8efa-39d7a39dbdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.747684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 177/347] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:52:29 2022] GET /identity/v3/users/ebc1e279281f4c53924e7b9449ace048 => generated 293 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:29.747994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28312d3e-a432-4fae-8efa-39d7a39dbdeb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.748281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28312d3e-a432-4fae-8efa-39d7a39dbdeb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.748559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28312d3e-a432-4fae-8efa-39d7a39dbdeb None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.748894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c855b0e-ab61-44aa-90e1-0f7623fe32be None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.749173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c855b0e-ab61-44aa-90e1-0f7623fe32be None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.749331 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28312d3e-a432-4fae-8efa-39d7a39dbdeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:29.749474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c855b0e-ab61-44aa-90e1-0f7623fe32be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:29.749613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28312d3e-a432-4fae-8efa-39d7a39dbdeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:29.750924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28312d3e-a432-4fae-8efa-39d7a39dbdeb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:29.759536 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 171/348] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:29.760474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28312d3e-a432-4fae-8efa-39d7a39dbdeb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.788957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-9c855b0e-ab61-44aa-90e1-0f7623fe32be None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:29.790411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-9c855b0e-ab61-44aa-90e1-0f7623fe32be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:29.863640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 178/349] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:29.864710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c855b0e-ab61-44aa-90e1-0f7623fe32be None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:29.872736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28312d3e-a432-4fae-8efa-39d7a39dbdeb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:29.904132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:29.909913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18d0a28-86fd-4dce-a6d5-c397f3062955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:29.910620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d0a28-86fd-4dce-a6d5-c397f3062955 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:29.910997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d0a28-86fd-4dce-a6d5-c397f3062955 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:29.911346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18d0a28-86fd-4dce-a6d5-c397f3062955 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.004733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c855b0e-ab61-44aa-90e1-0f7623fe32be None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:30.006577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:30.008459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d0a28-86fd-4dce-a6d5-c397f3062955 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:30.009887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18d0a28-86fd-4dce-a6d5-c397f3062955 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:30.042990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32e85a-e30e-44d9-af76-201e92f82c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:30.043845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32e85a-e30e-44d9-af76-201e92f82c42 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.044256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32e85a-e30e-44d9-af76-201e92f82c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.044658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32e85a-e30e-44d9-af76-201e92f82c42 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.045596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32e85a-e30e-44d9-af76-201e92f82c42 None admin] RBAC: Adding query filter params (role.id=4afb6e1cde9747919b7e855da11806b0, user.id=ebc1e279281f4c53924e7b9449ace048, scope.system=all) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:30.046072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32e85a-e30e-44d9-af76-201e92f82c42 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:30.047716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32e85a-e30e-44d9-af76-201e92f82c42 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:30.060431 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 179/350] 10.222.0.59 () {56 vars in 1308 bytes} [Thu Aug 18 20:52:29 2022] GET /identity/v3/role_assignments?user.id=ebc1e279281f4c53924e7b9449ace048&scope.system=all&role.id=4afb6e1cde9747919b7e855da11806b0 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:30.061514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32e85a-e30e-44d9-af76-201e92f82c42 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:30.128665 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 172/351] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:30.129824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c1b9d-714e-4040-a761-eafb434f2ca5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.130115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c1b9d-714e-4040-a761-eafb434f2ca5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.130391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7c1b9d-714e-4040-a761-eafb434f2ca5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.135198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 173/352] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:30.137854 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c1b9d-714e-4040-a761-eafb434f2ca5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:30.172083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32e85a-e30e-44d9-af76-201e92f82c42 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:30.184514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:30.209905 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b3540-f037-41ab-8df6-32d15732c349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:30.210890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b3540-f037-41ab-8df6-32d15732c349 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.211331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b3540-f037-41ab-8df6-32d15732c349 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.211789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0b3540-f037-41ab-8df6-32d15732c349 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.241320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:30.286013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b3540-f037-41ab-8df6-32d15732c349 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:30.287865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0b3540-f037-41ab-8df6-32d15732c349 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:30.299553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7c1b9d-714e-4040-a761-eafb434f2ca5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:30.347347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e387f6-9696-4e27-bd29-2e08bb782e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:30.347987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e387f6-9696-4e27-bd29-2e08bb782e93 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.348290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e387f6-9696-4e27-bd29-2e08bb782e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.348602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e387f6-9696-4e27-bd29-2e08bb782e93 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.349784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e387f6-9696-4e27-bd29-2e08bb782e93 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:30.351368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e387f6-9696-4e27-bd29-2e08bb782e93 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:30.355399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 174/353] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:30.356682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17800155-78ca-48d4-9cf3-efe71f7bb9c0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.356963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17800155-78ca-48d4-9cf3-efe71f7bb9c0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.357233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17800155-78ca-48d4-9cf3-efe71f7bb9c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.384059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-17800155-78ca-48d4-9cf3-efe71f7bb9c0 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:30.385192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-17800155-78ca-48d4-9cf3-efe71f7bb9c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:30.401555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 180/354] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:30.402814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b3540-f037-41ab-8df6-32d15732c349 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:30.463688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 175/355] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:30.464584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17800155-78ca-48d4-9cf3-efe71f7bb9c0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:30.475153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:30.509397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:30.523416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0b3540-f037-41ab-8df6-32d15732c349 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:30.571060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87ddea-95fc-498b-b54f-e13eaae28d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:30.571751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87ddea-95fc-498b-b54f-e13eaae28d5b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.572036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87ddea-95fc-498b-b54f-e13eaae28d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.572305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd87ddea-95fc-498b-b54f-e13eaae28d5b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.584102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd87ddea-95fc-498b-b54f-e13eaae28d5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-dd87ddea-95fc-498b-b54f-e13eaae28d5b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:30.589392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:30.590280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:30.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:30.591690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 181/356] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:30.592466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87ddea-95fc-498b-b54f-e13eaae28d5b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:30.593720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17800155-78ca-48d4-9cf3-efe71f7bb9c0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:30.637598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d46bc-05e8-419d-9cd0-69ac39342225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:30.638148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d46bc-05e8-419d-9cd0-69ac39342225 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.638421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d46bc-05e8-419d-9cd0-69ac39342225 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.638688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7d46bc-05e8-419d-9cd0-69ac39342225 None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.647924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d46bc-05e8-419d-9cd0-69ac39342225 None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:30.649664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7d46bc-05e8-419d-9cd0-69ac39342225 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:30.651660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 176/357] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:30.652593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d46bc-05e8-419d-9cd0-69ac39342225 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:30.718356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd87ddea-95fc-498b-b54f-e13eaae28d5b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:30.744774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:30.769130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311634ab-33f8-45d5-8784-2197867ddff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:30.770064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311634ab-33f8-45d5-8784-2197867ddff1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.770394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311634ab-33f8-45d5-8784-2197867ddff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.770676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311634ab-33f8-45d5-8784-2197867ddff1 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.773365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311634ab-33f8-45d5-8784-2197867ddff1 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:30.775723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311634ab-33f8-45d5-8784-2197867ddff1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:30.776337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:30.778687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 182/358] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:30.780010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311634ab-33f8-45d5-8784-2197867ddff1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:30.784960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7d46bc-05e8-419d-9cd0-69ac39342225 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:30.824217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8032c46-ea2d-48a2-b78f-c0f86ffbce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:30.825084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8032c46-ea2d-48a2-b78f-c0f86ffbce26 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.825361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8032c46-ea2d-48a2-b78f-c0f86ffbce26 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.826484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8032c46-ea2d-48a2-b78f-c0f86ffbce26 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.827819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8032c46-ea2d-48a2-b78f-c0f86ffbce26 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:30.827819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8032c46-ea2d-48a2-b78f-c0f86ffbce26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:30.828890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8032c46-ea2d-48a2-b78f-c0f86ffbce26 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:30.841492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 177/359] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:30.842822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db6c35-5713-4348-ad86-32ff82d7336d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.843112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db6c35-5713-4348-ad86-32ff82d7336d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.843383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36db6c35-5713-4348-ad86-32ff82d7336d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.844708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 178/360] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:30.845418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db6c35-5713-4348-ad86-32ff82d7336d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:30.904646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311634ab-33f8-45d5-8784-2197867ddff1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:30.946520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db58cc-f28e-4c2d-b58b-1946578c00da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:30.946520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db58cc-f28e-4c2d-b58b-1946578c00da None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:30.946520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db58cc-f28e-4c2d-b58b-1946578c00da None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:30.946520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0db58cc-f28e-4c2d-b58b-1946578c00da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:30.947151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db58cc-f28e-4c2d-b58b-1946578c00da None admin] RBAC: Adding query filter params (group.id=8a1b82a8b4dd44b2a3291763e713ba41, role.id=fc85aab66ae3471dbebf6a8340dbd444, scope.project.id=e745821f0ace4177a3094a0f8a054926) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:30.947151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db58cc-f28e-4c2d-b58b-1946578c00da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:30.947414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0db58cc-f28e-4c2d-b58b-1946578c00da None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:30.954087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 183/361] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/role_assignments?group.id=8a1b82a8b4dd44b2a3291763e713ba41&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:30.955202 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db58cc-f28e-4c2d-b58b-1946578c00da None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:30.966552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36db6c35-5713-4348-ad86-32ff82d7336d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.016780 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448632-6e55-440a-ab3b-690995b8fa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.017511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448632-6e55-440a-ab3b-690995b8fa3f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.017884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448632-6e55-440a-ab3b-690995b8fa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.018034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28448632-6e55-440a-ab3b-690995b8fa3f None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.021791 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28448632-6e55-440a-ab3b-690995b8fa3f None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.021791 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28448632-6e55-440a-ab3b-690995b8fa3f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.022885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 179/362] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:31.025967 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448632-6e55-440a-ab3b-690995b8fa3f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.036440 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.061281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.102748 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0db58cc-f28e-4c2d-b58b-1946578c00da None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.150212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9e5234-1638-41e7-8e79-604ee2d5fe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.150893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e5234-1638-41e7-8e79-604ee2d5fe90 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.151213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e5234-1638-41e7-8e79-604ee2d5fe90 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.151438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9e5234-1638-41e7-8e79-604ee2d5fe90 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.157065 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28448632-6e55-440a-ab3b-690995b8fa3f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.165449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9e5234-1638-41e7-8e79-604ee2d5fe90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-bf9e5234-1638-41e7-8e79-604ee2d5fe90 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:31.170605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:31.171700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:31.172559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 184/363] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:31.173955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7a915-d35c-4066-b079-b34c41cd098d None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.173955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7a915-d35c-4066-b079-b34c41cd098d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.174531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7a915-d35c-4066-b079-b34c41cd098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.196692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-19e7a915-d35c-4066-b079-b34c41cd098d None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:31.197817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-19e7a915-d35c-4066-b079-b34c41cd098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:31.207185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ba753-5719-4722-8c5b-d4b090448417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.209056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba753-5719-4722-8c5b-d4b090448417 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.209482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba753-5719-4722-8c5b-d4b090448417 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.210480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0ba753-5719-4722-8c5b-d4b090448417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.293730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 185/364] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:31.294589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7a915-d35c-4066-b079-b34c41cd098d None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.311255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ba753-5719-4722-8c5b-d4b090448417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.312739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0ba753-5719-4722-8c5b-d4b090448417 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.353704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.354310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.422932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7a915-d35c-4066-b079-b34c41cd098d None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.458460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 180/365] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:31.459553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ba753-5719-4722-8c5b-d4b090448417 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.466535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e825459-92cd-40ef-ad9a-fed9637af0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.467312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e825459-92cd-40ef-ad9a-fed9637af0dc None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.467689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e825459-92cd-40ef-ad9a-fed9637af0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.468084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e825459-92cd-40ef-ad9a-fed9637af0dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.468921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e825459-92cd-40ef-ad9a-fed9637af0dc None admin] RBAC: Adding query filter params (group.id=8a1b82a8b4dd44b2a3291763e713ba41, role.id=17053af642bb46de91cf75f9be9d458a, scope.project.id=e745821f0ace4177a3094a0f8a054926) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:31.471963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e825459-92cd-40ef-ad9a-fed9637af0dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.473546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e825459-92cd-40ef-ad9a-fed9637af0dc None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.479770 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 186/366] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/role_assignments?group.id=8a1b82a8b4dd44b2a3291763e713ba41&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=17053af642bb46de91cf75f9be9d458a => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:31.480900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e825459-92cd-40ef-ad9a-fed9637af0dc None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.589630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0ba753-5719-4722-8c5b-d4b090448417 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.604433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e825459-92cd-40ef-ad9a-fed9637af0dc None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.624535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.624762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.654702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d19d3-e3ba-40c9-b1c4-53a3772b205b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.655448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d19d3-e3ba-40c9-b1c4-53a3772b205b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.655740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d19d3-e3ba-40c9-b1c4-53a3772b205b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.656011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835d19d3-e3ba-40c9-b1c4-53a3772b205b None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.656749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d19d3-e3ba-40c9-b1c4-53a3772b205b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:31.657054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d19d3-e3ba-40c9-b1c4-53a3772b205b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.658471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835d19d3-e3ba-40c9-b1c4-53a3772b205b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.670044 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b0599-27be-4e33-98fb-350cd48d2d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.670708 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b0599-27be-4e33-98fb-350cd48d2d4c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.671015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b0599-27be-4e33-98fb-350cd48d2d4c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.671287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565b0599-27be-4e33-98fb-350cd48d2d4c None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.674370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 181/367] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:31.674920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b0599-27be-4e33-98fb-350cd48d2d4c None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.676529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565b0599-27be-4e33-98fb-350cd48d2d4c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.679140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 187/368] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:31.679860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d19d3-e3ba-40c9-b1c4-53a3772b205b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.683935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b0599-27be-4e33-98fb-350cd48d2d4c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.822941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835d19d3-e3ba-40c9-b1c4-53a3772b205b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.857378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565b0599-27be-4e33-98fb-350cd48d2d4c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:31.862594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3a5a6-ffff-470b-abab-ec6ff7a40e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.863514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a5a6-ffff-470b-abab-ec6ff7a40e82 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.863978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a5a6-ffff-470b-abab-ec6ff7a40e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.864386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c3a5a6-ffff-470b-abab-ec6ff7a40e82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.901224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b235-5795-4360-90ab-227a2d11ec1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:31.902043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b235-5795-4360-90ab-227a2d11ec1e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:31.902324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b235-5795-4360-90ab-227a2d11ec1e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:31.902614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2b235-5795-4360-90ab-227a2d11ec1e None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:31.905491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b235-5795-4360-90ab-227a2d11ec1e None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.907990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e2b235-5795-4360-90ab-227a2d11ec1e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.915230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 188/369] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:31.916002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b235-5795-4360-90ab-227a2d11ec1e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:31.934335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:31.952077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3a5a6-ffff-470b-abab-ec6ff7a40e82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:31.954001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c3a5a6-ffff-470b-abab-ec6ff7a40e82 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:31.981490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.058102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e2b235-5795-4360-90ab-227a2d11ec1e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.070501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 182/370] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:32.074698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3a5a6-ffff-470b-abab-ec6ff7a40e82 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.110696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0e64f-09bb-4d03-b0d6-e7f4601dd15c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.111991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0e64f-09bb-4d03-b0d6-e7f4601dd15c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.112824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0e64f-09bb-4d03-b0d6-e7f4601dd15c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.112934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0e64f-09bb-4d03-b0d6-e7f4601dd15c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.126741 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0e64f-09bb-4d03-b0d6-e7f4601dd15c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-80a0e64f-09bb-4d03-b0d6-e7f4601dd15c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:32.132342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:32.133271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:32.134103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 189/371] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:32.134793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0e64f-09bb-4d03-b0d6-e7f4601dd15c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.179174 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.198844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c3a5a6-ffff-470b-abab-ec6ff7a40e82 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.237119 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423e84-b40d-4cbf-86f1-66ee35539fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.238574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423e84-b40d-4cbf-86f1-66ee35539fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.239069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423e84-b40d-4cbf-86f1-66ee35539fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.239536 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c423e84-b40d-4cbf-86f1-66ee35539fb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.240477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423e84-b40d-4cbf-86f1-66ee35539fb2 None admin] RBAC: Adding query filter params (group.id=8a1b82a8b4dd44b2a3291763e713ba41, role.id=fc85aab66ae3471dbebf6a8340dbd444, scope.project.id=1e153a5d02af48acaf1b20217342aed9) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:32.240995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423e84-b40d-4cbf-86f1-66ee35539fb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.242762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c423e84-b40d-4cbf-86f1-66ee35539fb2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.250259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 183/372] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/role_assignments?group.id=8a1b82a8b4dd44b2a3291763e713ba41&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.253032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423e84-b40d-4cbf-86f1-66ee35539fb2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.283211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0e64f-09bb-4d03-b0d6-e7f4601dd15c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.313395 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.349993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ef212-a45a-42e0-bc80-620b9fcfa3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.350683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ef212-a45a-42e0-bc80-620b9fcfa3ea None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.351071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ef212-a45a-42e0-bc80-620b9fcfa3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.351428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033ef212-a45a-42e0-bc80-620b9fcfa3ea None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.357881 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ef212-a45a-42e0-bc80-620b9fcfa3ea None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.359484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033ef212-a45a-42e0-bc80-620b9fcfa3ea None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.361881 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 190/373] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.376616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ef212-a45a-42e0-bc80-620b9fcfa3ea None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.384575 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c423e84-b40d-4cbf-86f1-66ee35539fb2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.428651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa008-34b4-42e5-bf02-f3290527bfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.429276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa008-34b4-42e5-bf02-f3290527bfab None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.429556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa008-34b4-42e5-bf02-f3290527bfab None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.429830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaaa008-34b4-42e5-bf02-f3290527bfab None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.430527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaa008-34b4-42e5-bf02-f3290527bfab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:32.430863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaa008-34b4-42e5-bf02-f3290527bfab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.432300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaaa008-34b4-42e5-bf02-f3290527bfab None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.442209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 184/374] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.448961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa008-34b4-42e5-bf02-f3290527bfab None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.470020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.580560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033ef212-a45a-42e0-bc80-620b9fcfa3ea None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.651225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b592a-90d8-459f-89ab-5347a98bda83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.652742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b592a-90d8-459f-89ab-5347a98bda83 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.652742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b592a-90d8-459f-89ab-5347a98bda83 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.652742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4b592a-90d8-459f-89ab-5347a98bda83 None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.654122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b592a-90d8-459f-89ab-5347a98bda83 None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.656264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4b592a-90d8-459f-89ab-5347a98bda83 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.658281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 191/375] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:32.664990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b592a-90d8-459f-89ab-5347a98bda83 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:32.718165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaaa008-34b4-42e5-bf02-f3290527bfab None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.765024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:32.818120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb52aa-52db-4be3-9655-5f8cb55c8f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:32.818810 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb52aa-52db-4be3-9655-5f8cb55c8f68 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:32.819092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb52aa-52db-4be3-9655-5f8cb55c8f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:32.819407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7feb52aa-52db-4be3-9655-5f8cb55c8f68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:32.941104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb52aa-52db-4be3-9655-5f8cb55c8f68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:32.942866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7feb52aa-52db-4be3-9655-5f8cb55c8f68 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:32.953001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4b592a-90d8-459f-89ab-5347a98bda83 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:32.971223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:33.020272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d0c06-f482-4504-ac12-31f06d40c001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.021237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d0c06-f482-4504-ac12-31f06d40c001 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.021510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d0c06-f482-4504-ac12-31f06d40c001 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.021780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488d0c06-f482-4504-ac12-31f06d40c001 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.022526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d0c06-f482-4504-ac12-31f06d40c001 None admin] RBAC: Adding query filter params (group.id=8a1b82a8b4dd44b2a3291763e713ba41, role.id=17053af642bb46de91cf75f9be9d458a, scope.project.id=1e153a5d02af48acaf1b20217342aed9) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:33.022927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d0c06-f482-4504-ac12-31f06d40c001 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.024392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488d0c06-f482-4504-ac12-31f06d40c001 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.035887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 192/376] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/role_assignments?group.id=8a1b82a8b4dd44b2a3291763e713ba41&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=17053af642bb46de91cf75f9be9d458a => generated 260 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:33.097531 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 185/377] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 649 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:52:33.102475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d0c06-f482-4504-ac12-31f06d40c001 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.302008 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488d0c06-f482-4504-ac12-31f06d40c001 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.304503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:33.357134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec951a-0465-46ce-947b-b76edcef1a93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.358674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec951a-0465-46ce-947b-b76edcef1a93 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.359175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec951a-0465-46ce-947b-b76edcef1a93 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.359643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ec951a-0465-46ce-947b-b76edcef1a93 None admin] PATH_INFO: `/v3/projects/4e6b4204a03c4768887ce19cd521bf6b` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.361126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec951a-0465-46ce-947b-b76edcef1a93 None admin] RBAC: Authorizing `identity:get_project(project_id=4e6b4204a03c4768887ce19cd521bf6b)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.362906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ec951a-0465-46ce-947b-b76edcef1a93 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.365108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 193/378] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:33 2022] GET /identity/v3/projects/4e6b4204a03c4768887ce19cd521bf6b => generated 344 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:33.375915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb52aa-52db-4be3-9655-5f8cb55c8f68 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.532645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7feb52aa-52db-4be3-9655-5f8cb55c8f68 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.548442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:33.576452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66889720-95eb-442c-acec-77af5bda77fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.577416 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66889720-95eb-442c-acec-77af5bda77fc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.577888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66889720-95eb-442c-acec-77af5bda77fc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.578375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66889720-95eb-442c-acec-77af5bda77fc None admin] PATH_INFO: `/v3/groups/6debd54ee8494d539af5e5c640c78245` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.585529 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66889720-95eb-442c-acec-77af5bda77fc None admin] RBAC: Authorizing `identity:get_group(group_id=6debd54ee8494d539af5e5c640c78245)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.587046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66889720-95eb-442c-acec-77af5bda77fc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.588872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 186/379] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:33 2022] GET /identity/v3/groups/6debd54ee8494d539af5e5c640c78245 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:33.594976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec951a-0465-46ce-947b-b76edcef1a93 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:33.636978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a12c96-038e-45d9-8135-4d7fee770717 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.637348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a12c96-038e-45d9-8135-4d7fee770717 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.637618 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a12c96-038e-45d9-8135-4d7fee770717 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.639237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 187/380] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:33.644033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb16273-9d68-4a36-953a-ef2171adb299 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.644282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb16273-9d68-4a36-953a-ef2171adb299 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.644518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb16273-9d68-4a36-953a-ef2171adb299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.673692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4cb16273-9d68-4a36-953a-ef2171adb299 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:33.674999 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4cb16273-9d68-4a36-953a-ef2171adb299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:33.732321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ec951a-0465-46ce-947b-b76edcef1a93 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:33.778792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008038b0-ca05-4378-a0cd-90f9c41fb581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:33.778792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008038b0-ca05-4378-a0cd-90f9c41fb581 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:33.779087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008038b0-ca05-4378-a0cd-90f9c41fb581 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:33.780759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008038b0-ca05-4378-a0cd-90f9c41fb581 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:33.780759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008038b0-ca05-4378-a0cd-90f9c41fb581 None admin] RBAC: Adding query filter params (group.id=6debd54ee8494d539af5e5c640c78245, role.id=85a146946817410b9a3addcf041c5909, scope.project.id=4e6b4204a03c4768887ce19cd521bf6b) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:33.780759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008038b0-ca05-4378-a0cd-90f9c41fb581 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:33.781978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008038b0-ca05-4378-a0cd-90f9c41fb581 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:33.788602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 194/381] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Aug 18 20:52:33 2022] GET /identity/v3/role_assignments?group.id=6debd54ee8494d539af5e5c640c78245&scope.project.id=4e6b4204a03c4768887ce19cd521bf6b&role.id=85a146946817410b9a3addcf041c5909 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:33.824639 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 188/382] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:34.075440 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d2f71-ccea-4b78-b04a-017c07893245 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.075738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d2f71-ccea-4b78-b04a-017c07893245 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.076002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10d2f71-ccea-4b78-b04a-017c07893245 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.077561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 195/383] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:34.082878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d894f9-566a-492e-b616-2d67143cb4bf None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.083165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d894f9-566a-492e-b616-2d67143cb4bf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.083437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d894f9-566a-492e-b616-2d67143cb4bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.106918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-03d894f9-566a-492e-b616-2d67143cb4bf None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:34.108112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-03d894f9-566a-492e-b616-2d67143cb4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:34.171001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d2f71-ccea-4b78-b04a-017c07893245 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:34.201136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 189/384] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:34.226256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:34.311486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10d2f71-ccea-4b78-b04a-017c07893245 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:34.353371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dd873-a1cb-40f1-8c4d-d3fe1946fcaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.353933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dd873-a1cb-40f1-8c4d-d3fe1946fcaf None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.354212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dd873-a1cb-40f1-8c4d-d3fe1946fcaf None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.354483 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2dd873-a1cb-40f1-8c4d-d3fe1946fcaf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.371318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2dd873-a1cb-40f1-8c4d-d3fe1946fcaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-bc2dd873-a1cb-40f1-8c4d-d3fe1946fcaf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:34.380346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:34.381350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:34.382579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 196/385] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:34.389903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d894f9-566a-492e-b616-2d67143cb4bf None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:34.439948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:34.518545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d894f9-566a-492e-b616-2d67143cb4bf None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:34.560769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c835-93c6-4bf3-98a8-b3b68ed42e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.561388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c835-93c6-4bf3-98a8-b3b68ed42e4d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.561668 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c835-93c6-4bf3-98a8-b3b68ed42e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.561940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb5c835-93c6-4bf3-98a8-b3b68ed42e4d None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.562619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5c835-93c6-4bf3-98a8-b3b68ed42e4d None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:34.562949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5c835-93c6-4bf3-98a8-b3b68ed42e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:34.564335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb5c835-93c6-4bf3-98a8-b3b68ed42e4d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:34.573396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 190/386] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:34.579582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dd873-a1cb-40f1-8c4d-d3fe1946fcaf None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:34.640743 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c835-93c6-4bf3-98a8-b3b68ed42e4d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:34.723474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:34.741894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2dd873-a1cb-40f1-8c4d-d3fe1946fcaf None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:34.836770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:34.841231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb5c835-93c6-4bf3-98a8-b3b68ed42e4d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:34.854366 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6c3c9-8a5d-4b7c-bb13-ef367fe18ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.855114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6c3c9-8a5d-4b7c-bb13-ef367fe18ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.855380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6c3c9-8a5d-4b7c-bb13-ef367fe18ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.855652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6c3c9-8a5d-4b7c-bb13-ef367fe18ef0 None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.863484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6c3c9-8a5d-4b7c-bb13-ef367fe18ef0 None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:34.864983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6c3c9-8a5d-4b7c-bb13-ef367fe18ef0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:34.866940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 197/387] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:34 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:34.872664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6c3c9-8a5d-4b7c-bb13-ef367fe18ef0 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:34.887265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6aa8c-efb5-4a0f-b85a-fe8b0a883218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:34.887907 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6aa8c-efb5-4a0f-b85a-fe8b0a883218 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:34.888183 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6aa8c-efb5-4a0f-b85a-fe8b0a883218 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:34.888454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d6aa8c-efb5-4a0f-b85a-fe8b0a883218 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:34.911639 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d6aa8c-efb5-4a0f-b85a-fe8b0a883218 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-94d6aa8c-efb5-4a0f-b85a-fe8b0a883218 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:34.918311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:34.919212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:34.919984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:34.924586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 191/388] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:34.930960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6aa8c-efb5-4a0f-b85a-fe8b0a883218 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.092590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6c3c9-8a5d-4b7c-bb13-ef367fe18ef0 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.125181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d6aa8c-efb5-4a0f-b85a-fe8b0a883218 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.136531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccced91f-636f-4b45-8763-3ba4d85c412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.137221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccced91f-636f-4b45-8763-3ba4d85c412c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.137498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccced91f-636f-4b45-8763-3ba4d85c412c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.137768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccced91f-636f-4b45-8763-3ba4d85c412c None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.140692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccced91f-636f-4b45-8763-3ba4d85c412c None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.140692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccced91f-636f-4b45-8763-3ba4d85c412c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.142286 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 198/389] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:34 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:35.149906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a0628-3bb7-4402-bedc-c00adb672c6d None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.149906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a0628-3bb7-4402-bedc-c00adb672c6d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.149906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a0628-3bb7-4402-bedc-c00adb672c6d None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.151383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 199/390] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:35.156232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3a5f4-5391-4f15-a994-c2fac7292854 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.159115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3a5f4-5391-4f15-a994-c2fac7292854 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.159611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d3a5f4-5391-4f15-a994-c2fac7292854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.180521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011873c-6ed2-413a-b10b-b8fc3347a6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.181465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011873c-6ed2-413a-b10b-b8fc3347a6fe None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.182507 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011873c-6ed2-413a-b10b-b8fc3347a6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.183109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011873c-6ed2-413a-b10b-b8fc3347a6fe None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.183985 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011873c-6ed2-413a-b10b-b8fc3347a6fe None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:35.184620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011873c-6ed2-413a-b10b-b8fc3347a6fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.186354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a011873c-6ed2-413a-b10b-b8fc3347a6fe None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.193333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-e9d3a5f4-5391-4f15-a994-c2fac7292854 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:35.194825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e9d3a5f4-5391-4f15-a994-c2fac7292854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:35.196495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 192/391] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:35.197783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011873c-6ed2-413a-b10b-b8fc3347a6fe None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.231792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:35.233967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:35.294435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 200/392] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:35.295162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3a5f4-5391-4f15-a994-c2fac7292854 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.343179 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011873c-6ed2-413a-b10b-b8fc3347a6fe None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.383792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb64be5-875e-496d-aa2f-4189eea7e1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.384460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb64be5-875e-496d-aa2f-4189eea7e1b6 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.384741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb64be5-875e-496d-aa2f-4189eea7e1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.385015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb64be5-875e-496d-aa2f-4189eea7e1b6 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926/groups/8a1b82a8b4dd44b2a3291763e713ba41/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.387089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb64be5-875e-496d-aa2f-4189eea7e1b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=e745821f0ace4177a3094a0f8a054926, group_id=8a1b82a8b4dd44b2a3291763e713ba41, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.389168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb64be5-875e-496d-aa2f-4189eea7e1b6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.407423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 193/393] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Aug 18 20:52:35 2022] PUT /identity/v3/projects/e745821f0ace4177a3094a0f8a054926/groups/8a1b82a8b4dd44b2a3291763e713ba41/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:35.427028 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d3a5f4-5391-4f15-a994-c2fac7292854 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.469682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a658a14e-8765-49e1-82c5-9876d3f7b097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.470554 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a14e-8765-49e1-82c5-9876d3f7b097 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.471018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a14e-8765-49e1-82c5-9876d3f7b097 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.471442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a658a14e-8765-49e1-82c5-9876d3f7b097 None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.472842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658a14e-8765-49e1-82c5-9876d3f7b097 None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.474481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a658a14e-8765-49e1-82c5-9876d3f7b097 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.476330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 201/394] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:35 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:35.482671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb64be5-875e-496d-aa2f-4189eea7e1b6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.563194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e4972-b71e-4c6a-b564-f451be5cfbbc None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.563950 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e4972-b71e-4c6a-b564-f451be5cfbbc None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.564431 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6e4972-b71e-4c6a-b564-f451be5cfbbc None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.566526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 202/395] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:35.571630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545ed31-e72f-49ce-8111-78c08f24a134 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.572198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545ed31-e72f-49ce-8111-78c08f24a134 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.572684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545ed31-e72f-49ce-8111-78c08f24a134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.582219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:35.607068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-0545ed31-e72f-49ce-8111-78c08f24a134 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:35.607295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb64be5-875e-496d-aa2f-4189eea7e1b6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.608831 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0545ed31-e72f-49ce-8111-78c08f24a134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:35.646836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c89e07-2727-41cb-8550-f52163c6bd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.648647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c89e07-2727-41cb-8550-f52163c6bd96 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.649068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c89e07-2727-41cb-8550-f52163c6bd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.650758 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c89e07-2727-41cb-8550-f52163c6bd96 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.651193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c89e07-2727-41cb-8550-f52163c6bd96 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.656404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c89e07-2727-41cb-8550-f52163c6bd96 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.656404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 194/396] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:35 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:35.660604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:35.661126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c89e07-2727-41cb-8550-f52163c6bd96 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.740085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 203/397] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:35.740959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545ed31-e72f-49ce-8111-78c08f24a134 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.852610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545ed31-e72f-49ce-8111-78c08f24a134 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.868688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c89e07-2727-41cb-8550-f52163c6bd96 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:35.910229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378486-40f2-42f3-8c63-a260b5da3282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.910900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378486-40f2-42f3-8c63-a260b5da3282 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.911178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378486-40f2-42f3-8c63-a260b5da3282 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.911443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92378486-40f2-42f3-8c63-a260b5da3282 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.927721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c601c4-66f7-429d-8d9b-2645a98b238c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:35.928382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c601c4-66f7-429d-8d9b-2645a98b238c None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:35.928661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c601c4-66f7-429d-8d9b-2645a98b238c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:35.928924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c601c4-66f7-429d-8d9b-2645a98b238c None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926/groups/8a1b82a8b4dd44b2a3291763e713ba41/roles/17053af642bb46de91cf75f9be9d458a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:35.933242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92378486-40f2-42f3-8c63-a260b5da3282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-92378486-40f2-42f3-8c63-a260b5da3282 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:35.937952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:35.938957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:35.939771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:35.940392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c601c4-66f7-429d-8d9b-2645a98b238c None admin] RBAC: Authorizing `identity:create_grant(project_id=e745821f0ace4177a3094a0f8a054926, group_id=8a1b82a8b4dd44b2a3291763e713ba41, role_id=17053af642bb46de91cf75f9be9d458a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:35.944437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c601c4-66f7-429d-8d9b-2645a98b238c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:35.950796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 204/398] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:35.951937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378486-40f2-42f3-8c63-a260b5da3282 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:35.970362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 195/399] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Aug 18 20:52:35 2022] PUT /identity/v3/projects/e745821f0ace4177a3094a0f8a054926/groups/8a1b82a8b4dd44b2a3291763e713ba41/roles/17053af642bb46de91cf75f9be9d458a => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:52:35.993528 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.013470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c601c4-66f7-429d-8d9b-2645a98b238c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.031196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.146373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92378486-40f2-42f3-8c63-a260b5da3282 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.192419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44065d2-41b7-42e1-84cd-d114a07181cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.193033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44065d2-41b7-42e1-84cd-d114a07181cb None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.193308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44065d2-41b7-42e1-84cd-d114a07181cb None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.193582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44065d2-41b7-42e1-84cd-d114a07181cb None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.193809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c601c4-66f7-429d-8d9b-2645a98b238c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.194252 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44065d2-41b7-42e1-84cd-d114a07181cb None admin] RBAC: Adding query filter params (name=member) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:36.194551 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44065d2-41b7-42e1-84cd-d114a07181cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.197213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44065d2-41b7-42e1-84cd-d114a07181cb None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:36.208005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 205/400] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:36.219843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44065d2-41b7-42e1-84cd-d114a07181cb None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.241418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b31cf-8667-4121-af76-3d5e47df650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.242058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b31cf-8667-4121-af76-3d5e47df650d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.242331 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b31cf-8667-4121-af76-3d5e47df650d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.242641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b31cf-8667-4121-af76-3d5e47df650d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.254366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b31cf-8667-4121-af76-3d5e47df650d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-799b31cf-8667-4121-af76-3d5e47df650d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:36.259096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:36.259959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:36.260745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 196/401] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:36.266030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b31cf-8667-4121-af76-3d5e47df650d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.372011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.407999 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b31cf-8667-4121-af76-3d5e47df650d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.411848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44065d2-41b7-42e1-84cd-d114a07181cb None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.415065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.449398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c3dbb3-2f68-4db6-9446-15f09d1e55b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.449979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3dbb3-2f68-4db6-9446-15f09d1e55b9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.450226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3dbb3-2f68-4db6-9446-15f09d1e55b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.450495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c3dbb3-2f68-4db6-9446-15f09d1e55b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.451200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3dbb3-2f68-4db6-9446-15f09d1e55b9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:36.451509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3dbb3-2f68-4db6-9446-15f09d1e55b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.452901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c3dbb3-2f68-4db6-9446-15f09d1e55b9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:36.460339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cdf6d4-6b07-4746-a2af-e7edb284e47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.461580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdf6d4-6b07-4746-a2af-e7edb284e47f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.462064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdf6d4-6b07-4746-a2af-e7edb284e47f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.462189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 197/402] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:36.462666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cdf6d4-6b07-4746-a2af-e7edb284e47f None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.463860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744257e-4fda-49b9-81f3-a5cde304ca1d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.464259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744257e-4fda-49b9-81f3-a5cde304ca1d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.464473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdf6d4-6b07-4746-a2af-e7edb284e47f None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.464583 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5744257e-4fda-49b9-81f3-a5cde304ca1d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.466818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cdf6d4-6b07-4746-a2af-e7edb284e47f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:36.466946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 198/403] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:36.467224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744257e-4fda-49b9-81f3-a5cde304ca1d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.472555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 206/404] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:36 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:36.473752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a693b6-c05a-4f3f-bcb0-dfca75f28d9f None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.474029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a693b6-c05a-4f3f-bcb0-dfca75f28d9f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.474305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a693b6-c05a-4f3f-bcb0-dfca75f28d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.492637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-17a693b6-c05a-4f3f-bcb0-dfca75f28d9f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:36.493937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-17a693b6-c05a-4f3f-bcb0-dfca75f28d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:36.566797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 207/405] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:36.567681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a693b6-c05a-4f3f-bcb0-dfca75f28d9f None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.600003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5744257e-4fda-49b9-81f3-a5cde304ca1d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.635538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.643500 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11afda-d27e-426a-8272-b6fc0d88cb9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.644419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11afda-d27e-426a-8272-b6fc0d88cb9a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.644926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11afda-d27e-426a-8272-b6fc0d88cb9a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.645387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11afda-d27e-426a-8272-b6fc0d88cb9a None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.647156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11afda-d27e-426a-8272-b6fc0d88cb9a None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.648801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11afda-d27e-426a-8272-b6fc0d88cb9a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:36.650856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.651056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 199/406] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:36 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:36.657330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11afda-d27e-426a-8272-b6fc0d88cb9a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.676676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a693b6-c05a-4f3f-bcb0-dfca75f28d9f None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.712976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605e3a-1194-4bdc-b376-7b751abb4861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.713892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605e3a-1194-4bdc-b376-7b751abb4861 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.714435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605e3a-1194-4bdc-b376-7b751abb4861 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.715068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2605e3a-1194-4bdc-b376-7b751abb4861 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.716362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605e3a-1194-4bdc-b376-7b751abb4861 None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.717935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2605e3a-1194-4bdc-b376-7b751abb4861 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:36.722849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 208/407] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:36 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:36.726054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605e3a-1194-4bdc-b376-7b751abb4861 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.765083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11afda-d27e-426a-8272-b6fc0d88cb9a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.801264 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978f6a-1633-4eca-ac18-dee3f7ccbdb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.802017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978f6a-1633-4eca-ac18-dee3f7ccbdb6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.802389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978f6a-1633-4eca-ac18-dee3f7ccbdb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.802753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24978f6a-1633-4eca-ac18-dee3f7ccbdb6 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.804152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24978f6a-1633-4eca-ac18-dee3f7ccbdb6 None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.805587 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24978f6a-1633-4eca-ac18-dee3f7ccbdb6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:36.807655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 200/408] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:36 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:36.813982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978f6a-1633-4eca-ac18-dee3f7ccbdb6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:36.844418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2605e3a-1194-4bdc-b376-7b751abb4861 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.879654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ee35-ffb4-49ce-9e62-1a7d34feb37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.880545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ee35-ffb4-49ce-9e62-1a7d34feb37b None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.880955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ee35-ffb4-49ce-9e62-1a7d34feb37b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.881384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be23ee35-ffb4-49ce-9e62-1a7d34feb37b None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9/groups/8a1b82a8b4dd44b2a3291763e713ba41/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.882514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:36.883911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23ee35-ffb4-49ce-9e62-1a7d34feb37b None admin] RBAC: Authorizing `identity:create_grant(project_id=1e153a5d02af48acaf1b20217342aed9, group_id=8a1b82a8b4dd44b2a3291763e713ba41, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.885572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be23ee35-ffb4-49ce-9e62-1a7d34feb37b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:36.903945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 209/409] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Aug 18 20:52:36 2022] PUT /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9/groups/8a1b82a8b4dd44b2a3291763e713ba41/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:52:36.932402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24978f6a-1633-4eca-ac18-dee3f7ccbdb6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:36.979926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd36a4f-8bb4-4903-9a57-449d9d23ac22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:36.980540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd36a4f-8bb4-4903-9a57-449d9d23ac22 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:36.980821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd36a4f-8bb4-4903-9a57-449d9d23ac22 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:36.981097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd36a4f-8bb4-4903-9a57-449d9d23ac22 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9/groups/8a1b82a8b4dd44b2a3291763e713ba41/roles/17053af642bb46de91cf75f9be9d458a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:36.983571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd36a4f-8bb4-4903-9a57-449d9d23ac22 None admin] RBAC: Authorizing `identity:create_grant(project_id=1e153a5d02af48acaf1b20217342aed9, group_id=8a1b82a8b4dd44b2a3291763e713ba41, role_id=17053af642bb46de91cf75f9be9d458a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:36.985066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd36a4f-8bb4-4903-9a57-449d9d23ac22 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.002233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 201/410] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Aug 18 20:52:36 2022] PUT /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9/groups/8a1b82a8b4dd44b2a3291763e713ba41/roles/17053af642bb46de91cf75f9be9d458a => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:52:37.074556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ee35-ffb4-49ce-9e62-1a7d34feb37b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.093824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.207045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be23ee35-ffb4-49ce-9e62-1a7d34feb37b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.245683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cefa2-820b-4ee7-a8f9-50df8c6082c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.246707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cefa2-820b-4ee7-a8f9-50df8c6082c2 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.247263 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cefa2-820b-4ee7-a8f9-50df8c6082c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.247725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933cefa2-820b-4ee7-a8f9-50df8c6082c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.258886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933cefa2-820b-4ee7-a8f9-50df8c6082c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-933cefa2-820b-4ee7-a8f9-50df8c6082c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:37.264471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:37.265354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:37.266237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:37.268869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 210/411] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:37.275420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd36a4f-8bb4-4903-9a57-449d9d23ac22 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.393476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd36a4f-8bb4-4903-9a57-449d9d23ac22 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.430702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.437973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a0cef-63a2-48e9-9808-d7809ddada2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.438925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a0cef-63a2-48e9-9808-d7809ddada2b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.439446 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a0cef-63a2-48e9-9808-d7809ddada2b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.440044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595a0cef-63a2-48e9-9808-d7809ddada2b None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.440954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a0cef-63a2-48e9-9808-d7809ddada2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:37.441448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a0cef-63a2-48e9-9808-d7809ddada2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.443056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595a0cef-63a2-48e9-9808-d7809ddada2b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.456312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 202/412] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:37.462863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cefa2-820b-4ee7-a8f9-50df8c6082c2 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.537842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.577648 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933cefa2-820b-4ee7-a8f9-50df8c6082c2 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.613011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492da2d3-e9a2-417a-b4f0-e314853b991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.614032 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da2d3-e9a2-417a-b4f0-e314853b991b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.614531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da2d3-e9a2-417a-b4f0-e314853b991b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.615037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492da2d3-e9a2-417a-b4f0-e314853b991b None admin] PATH_INFO: `/v3/groups/6debd54ee8494d539af5e5c640c78245` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.616347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492da2d3-e9a2-417a-b4f0-e314853b991b None admin] RBAC: Authorizing `identity:get_group(group_id=6debd54ee8494d539af5e5c640c78245)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.618006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492da2d3-e9a2-417a-b4f0-e314853b991b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.620117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 211/413] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:37 2022] GET /identity/v3/groups/6debd54ee8494d539af5e5c640c78245 => generated 229 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:37.625911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a0cef-63a2-48e9-9808-d7809ddada2b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.755859 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595a0cef-63a2-48e9-9808-d7809ddada2b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.793094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a37517-c922-4f22-84ce-87865fc5e595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.794171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a37517-c922-4f22-84ce-87865fc5e595 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.794646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a37517-c922-4f22-84ce-87865fc5e595 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.795151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a37517-c922-4f22-84ce-87865fc5e595 None admin] PATH_INFO: `/v3/projects/4e6b4204a03c4768887ce19cd521bf6b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.796481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a37517-c922-4f22-84ce-87865fc5e595 None admin] RBAC: Authorizing `identity:get_project(project_id=4e6b4204a03c4768887ce19cd521bf6b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.798125 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a37517-c922-4f22-84ce-87865fc5e595 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.800338 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 203/414] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:37 2022] GET /identity/v3/projects/4e6b4204a03c4768887ce19cd521bf6b => generated 344 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:37.805896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492da2d3-e9a2-417a-b4f0-e314853b991b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:37.927373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492da2d3-e9a2-417a-b4f0-e314853b991b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:37.963384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00f53f-b221-4b31-99ad-57a3d2ac22e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:37.964488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00f53f-b221-4b31-99ad-57a3d2ac22e7 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.964959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00f53f-b221-4b31-99ad-57a3d2ac22e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.965421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00f53f-b221-4b31-99ad-57a3d2ac22e7 None admin] PATH_INFO: `/v3/projects/4e6b4204a03c4768887ce19cd521bf6b/groups/6debd54ee8494d539af5e5c640c78245/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.967565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00f53f-b221-4b31-99ad-57a3d2ac22e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4e6b4204a03c4768887ce19cd521bf6b, group_id=6debd54ee8494d539af5e5c640c78245, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:37.969264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00f53f-b221-4b31-99ad-57a3d2ac22e7 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:37.971749 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:37.980451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9ad4b-9b3f-495b-9136-559523d4eeb3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.980908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9ad4b-9b3f-495b-9136-559523d4eeb3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.981150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae9ad4b-9b3f-495b-9136-559523d4eeb3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.986655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 204/415] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:37.988145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad176-be19-4b62-bfe8-952bef8547ef None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:37.988426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad176-be19-4b62-bfe8-952bef8547ef None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:37.988784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad176-be19-4b62-bfe8-952bef8547ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:37.993436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 212/416] 10.222.0.59 () {58 vars in 1442 bytes} [Thu Aug 18 20:52:37 2022] PUT /identity/v3/projects/4e6b4204a03c4768887ce19cd521bf6b/groups/6debd54ee8494d539af5e5c640c78245/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:38.010952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-de9ad176-be19-4b62-bfe8-952bef8547ef None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:38.012567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-de9ad176-be19-4b62-bfe8-952bef8547ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:38.074576 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:38.100551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 205/417] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:38.194877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d364c0-b8cc-4623-b197-a8b7a853b721 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.195249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d364c0-b8cc-4623-b197-a8b7a853b721 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.195428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d364c0-b8cc-4623-b197-a8b7a853b721 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.196810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 213/418] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:38.202249 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978651-d8cb-4cb5-9153-86b942c8b691 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.202538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978651-d8cb-4cb5-9153-86b942c8b691 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.202849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e978651-d8cb-4cb5-9153-86b942c8b691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.225614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9e978651-d8cb-4cb5-9153-86b942c8b691 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:38.226829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9e978651-d8cb-4cb5-9153-86b942c8b691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:38.301368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 206/419] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:38.438677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d364c0-b8cc-4623-b197-a8b7a853b721 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.572417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d364c0-b8cc-4623-b197-a8b7a853b721 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.608508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d88c45-bb05-42c6-8fa1-f6564c11be0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.609525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88c45-bb05-42c6-8fa1-f6564c11be0f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.609990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88c45-bb05-42c6-8fa1-f6564c11be0f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.610457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d88c45-bb05-42c6-8fa1-f6564c11be0f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.621292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e978651-d8cb-4cb5-9153-86b942c8b691 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.622674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d88c45-bb05-42c6-8fa1-f6564c11be0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-30d88c45-bb05-42c6-8fa1-f6564c11be0f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:38.628150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:38.629098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:38.629886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:38.632622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 214/420] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:38.639929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d88c45-bb05-42c6-8fa1-f6564c11be0f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.721611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:38.761558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e978651-d8cb-4cb5-9153-86b942c8b691 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.791373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d88c45-bb05-42c6-8fa1-f6564c11be0f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:38.804606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:38.830436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfd1de-14bf-4265-bac2-b165a0aa755a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.831142 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfd1de-14bf-4265-bac2-b165a0aa755a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.831433 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfd1de-14bf-4265-bac2-b165a0aa755a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.831703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfd1de-14bf-4265-bac2-b165a0aa755a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.853589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfd1de-14bf-4265-bac2-b165a0aa755a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-88dfd1de-14bf-4265-bac2-b165a0aa755a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:38.858503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:38.859370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:38.860597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 207/421] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:38.865789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29e9d-07ec-470e-bc6c-8200a931edd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:38.866410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29e9d-07ec-470e-bc6c-8200a931edd0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:38.866691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29e9d-07ec-470e-bc6c-8200a931edd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:38.866984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a29e9d-07ec-470e-bc6c-8200a931edd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:38.867655 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a29e9d-07ec-470e-bc6c-8200a931edd0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:38.867959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a29e9d-07ec-470e-bc6c-8200a931edd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:38.869346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a29e9d-07ec-470e-bc6c-8200a931edd0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:38.872914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfd1de-14bf-4265-bac2-b165a0aa755a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.889349 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 215/422] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:38.897290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29e9d-07ec-470e-bc6c-8200a931edd0 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:38.999427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfd1de-14bf-4265-bac2-b165a0aa755a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.033324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a29e9d-07ec-470e-bc6c-8200a931edd0 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.043708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97037b-bc1a-4cfd-9c0a-f52f83716a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.046232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97037b-bc1a-4cfd-9c0a-f52f83716a26 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.046764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97037b-bc1a-4cfd-9c0a-f52f83716a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.047483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b97037b-bc1a-4cfd-9c0a-f52f83716a26 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.049360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97037b-bc1a-4cfd-9c0a-f52f83716a26 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:39.050075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97037b-bc1a-4cfd-9c0a-f52f83716a26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.053239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b97037b-bc1a-4cfd-9c0a-f52f83716a26 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.063433 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 208/423] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:39.069942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97037b-bc1a-4cfd-9c0a-f52f83716a26 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.070359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.107904 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d1292-94a9-4614-84b0-f7e39c86a390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.108711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d1292-94a9-4614-84b0-f7e39c86a390 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.108993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d1292-94a9-4614-84b0-f7e39c86a390 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.109262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d1292-94a9-4614-84b0-f7e39c86a390 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.146952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.223998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b97037b-bc1a-4cfd-9c0a-f52f83716a26 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.264271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aadec1b-1fa3-4d41-899a-89bf9977161b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.265292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadec1b-1fa3-4d41-899a-89bf9977161b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.265835 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadec1b-1fa3-4d41-899a-89bf9977161b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.266256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aadec1b-1fa3-4d41-899a-89bf9977161b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.269128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d1292-94a9-4614-84b0-f7e39c86a390 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.270764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030d1292-94a9-4614-84b0-f7e39c86a390 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.377191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadec1b-1fa3-4d41-899a-89bf9977161b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.378952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aadec1b-1fa3-4d41-899a-89bf9977161b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.422450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.464042 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 216/424] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 567 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:39.465344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05842c-770c-4877-b654-ddd89a94cf6a None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.465633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05842c-770c-4877-b654-ddd89a94cf6a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.465908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05842c-770c-4877-b654-ddd89a94cf6a None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.472016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 217/425] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:39 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:39.473072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05842c-770c-4877-b654-ddd89a94cf6a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.494396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 209/426] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:52:39.494958 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.497745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac06925-6e07-4c48-a5b3-0be770caaecd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.498172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac06925-6e07-4c48-a5b3-0be770caaecd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.498580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac06925-6e07-4c48-a5b3-0be770caaecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.519203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3ac06925-6e07-4c48-a5b3-0be770caaecd None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:39.520644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3ac06925-6e07-4c48-a5b3-0be770caaecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:39.586557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f05842c-770c-4877-b654-ddd89a94cf6a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.594559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 210/427] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:39.595713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac06925-6e07-4c48-a5b3-0be770caaecd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.669478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.671782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152a0ce9-a6e6-4c3d-9e50-9d31f4b1e406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.672621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a0ce9-a6e6-4c3d-9e50-9d31f4b1e406 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.673036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a0ce9-a6e6-4c3d-9e50-9d31f4b1e406 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.673441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152a0ce9-a6e6-4c3d-9e50-9d31f4b1e406 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.674715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a0ce9-a6e6-4c3d-9e50-9d31f4b1e406 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.676360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152a0ce9-a6e6-4c3d-9e50-9d31f4b1e406 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.678559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 218/428] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:39.684675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f623a7-d983-4323-9566-27d14d3673f6 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.685151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f623a7-d983-4323-9566-27d14d3673f6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.685658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f623a7-d983-4323-9566-27d14d3673f6 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.687481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 219/429] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:39.689320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f623a7-d983-4323-9566-27d14d3673f6 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.706079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac06925-6e07-4c48-a5b3-0be770caaecd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.743155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da73676b-b08c-4ebf-9f2e-d97f9b2bb3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.743782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73676b-b08c-4ebf-9f2e-d97f9b2bb3d6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.744056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73676b-b08c-4ebf-9f2e-d97f9b2bb3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.744420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da73676b-b08c-4ebf-9f2e-d97f9b2bb3d6 None admin] PATH_INFO: `/v3/projects/e745821f0ace4177a3094a0f8a054926` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.745908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73676b-b08c-4ebf-9f2e-d97f9b2bb3d6 None admin] RBAC: Authorizing `identity:get_project(project_id=e745821f0ace4177a3094a0f8a054926)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.747552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da73676b-b08c-4ebf-9f2e-d97f9b2bb3d6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.753733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 211/430] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/projects/e745821f0ace4177a3094a0f8a054926 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:39.753733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8946b6-2684-4850-a73e-2454eb2ea343 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.753733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8946b6-2684-4850-a73e-2454eb2ea343 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.753733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8946b6-2684-4850-a73e-2454eb2ea343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.782190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0b8946b6-2684-4850-a73e-2454eb2ea343 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:39.783424 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0b8946b6-2684-4850-a73e-2454eb2ea343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:39.797722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.820588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f623a7-d983-4323-9566-27d14d3673f6 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.860786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 212/431] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:39.861798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8946b6-2684-4850-a73e-2454eb2ea343 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.867238 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716a523-156a-4f07-8910-9909a11f2083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:39.868077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a523-156a-4f07-8910-9909a11f2083 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:39.868506 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a523-156a-4f07-8910-9909a11f2083 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:39.868916 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6716a523-156a-4f07-8910-9909a11f2083 None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:39.870897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716a523-156a-4f07-8910-9909a11f2083 None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:39.873170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6716a523-156a-4f07-8910-9909a11f2083 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:39.875942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 220/432] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:39.881808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716a523-156a-4f07-8910-9909a11f2083 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:39.933819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:39.972065 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8946b6-2684-4850-a73e-2454eb2ea343 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:39.988071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6716a523-156a-4f07-8910-9909a11f2083 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.008033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5932b-f37f-482e-a21f-21df7a3b0393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.008662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5932b-f37f-482e-a21f-21df7a3b0393 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.008936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5932b-f37f-482e-a21f-21df7a3b0393 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.009198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e5932b-f37f-482e-a21f-21df7a3b0393 None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.010366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5932b-f37f-482e-a21f-21df7a3b0393 None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.012134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e5932b-f37f-482e-a21f-21df7a3b0393 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.014112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 213/433] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:40.019231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5932b-f37f-482e-a21f-21df7a3b0393 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.033751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cbc2b-6aa8-4341-bdb8-1726f82288e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.034369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cbc2b-6aa8-4341-bdb8-1726f82288e8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.034642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cbc2b-6aa8-4341-bdb8-1726f82288e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.035087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3cbc2b-6aa8-4341-bdb8-1726f82288e8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.036234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cbc2b-6aa8-4341-bdb8-1726f82288e8 None admin] RBAC: Adding query filter params (group.id=8a1b82a8b4dd44b2a3291763e713ba41, role.id=fc85aab66ae3471dbebf6a8340dbd444, scope.project.id=e745821f0ace4177a3094a0f8a054926) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:40.036546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cbc2b-6aa8-4341-bdb8-1726f82288e8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.038267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3cbc2b-6aa8-4341-bdb8-1726f82288e8 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.050792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 221/434] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Aug 18 20:52:39 2022] GET /identity/v3/role_assignments?group.id=8a1b82a8b4dd44b2a3291763e713ba41&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:40.050792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cbc2b-6aa8-4341-bdb8-1726f82288e8 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.091169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:40.187542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e5932b-f37f-482e-a21f-21df7a3b0393 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.228489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4e416-0a53-4b5a-8857-677c6403bd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.229122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4e416-0a53-4b5a-8857-677c6403bd01 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.229506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4e416-0a53-4b5a-8857-677c6403bd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.229832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a4e416-0a53-4b5a-8857-677c6403bd01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.232513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:40.241953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a4e416-0a53-4b5a-8857-677c6403bd01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:40.244781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3cbc2b-6aa8-4341-bdb8-1726f82288e8 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b0a4e416-0a53-4b5a-8857-677c6403bd01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:40.247116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:40.247973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 214/435] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:40.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4e416-0a53-4b5a-8857-677c6403bd01 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.296252 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e8296-b578-4bba-bf32-b143e71db41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.296873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8296-b578-4bba-bf32-b143e71db41b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.297154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8296-b578-4bba-bf32-b143e71db41b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.297429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8296-b578-4bba-bf32-b143e71db41b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.298158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e8296-b578-4bba-bf32-b143e71db41b None admin] RBAC: Adding query filter params (group.id=8a1b82a8b4dd44b2a3291763e713ba41, role.id=17053af642bb46de91cf75f9be9d458a, scope.project.id=e745821f0ace4177a3094a0f8a054926) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:40.298815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e8296-b578-4bba-bf32-b143e71db41b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.299949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e8296-b578-4bba-bf32-b143e71db41b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.306247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 222/436] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/role_assignments?group.id=8a1b82a8b4dd44b2a3291763e713ba41&scope.project.id=e745821f0ace4177a3094a0f8a054926&role.id=17053af642bb46de91cf75f9be9d458a => generated 611 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:40.308161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e8296-b578-4bba-bf32-b143e71db41b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.388006 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a4e416-0a53-4b5a-8857-677c6403bd01 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.430178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:40.438377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ff8ef-7936-4795-bd71-fa3f52294cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.439948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ff8ef-7936-4795-bd71-fa3f52294cfb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.439948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ff8ef-7936-4795-bd71-fa3f52294cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.439948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ff8ef-7936-4795-bd71-fa3f52294cfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.456166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ff8ef-7936-4795-bd71-fa3f52294cfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-2f6ff8ef-7936-4795-bd71-fa3f52294cfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:40.461482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:40.462359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 18 20:52:40.463163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:40.465241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e8296-b578-4bba-bf32-b143e71db41b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.466674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 215/437] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:40.468215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393a2c9-b2a8-4201-92b4-1a8333b3622c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.468491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393a2c9-b2a8-4201-92b4-1a8333b3622c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.468761 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9393a2c9-b2a8-4201-92b4-1a8333b3622c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.470033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 216/438] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:40.474905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393a2c9-b2a8-4201-92b4-1a8333b3622c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.511426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda38a0b-6c3d-49ad-8af4-b2d8bd209ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.511976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda38a0b-6c3d-49ad-8af4-b2d8bd209ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.512254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda38a0b-6c3d-49ad-8af4-b2d8bd209ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.512520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda38a0b-6c3d-49ad-8af4-b2d8bd209ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.513192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda38a0b-6c3d-49ad-8af4-b2d8bd209ca2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:40.513497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda38a0b-6c3d-49ad-8af4-b2d8bd209ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.515929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda38a0b-6c3d-49ad-8af4-b2d8bd209ca2 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.525605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 223/439] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:40.526953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011091a-9085-40ff-b1f4-4e79f145da02 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.527336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011091a-9085-40ff-b1f4-4e79f145da02 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.527608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011091a-9085-40ff-b1f4-4e79f145da02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.545816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:40.549067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-a011091a-9085-40ff-b1f4-4e79f145da02 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:40.550277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a011091a-9085-40ff-b1f4-4e79f145da02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:40.598407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9393a2c9-b2a8-4201-92b4-1a8333b3622c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.627269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 224/440] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:40.636121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011091a-9085-40ff-b1f4-4e79f145da02 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.639734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d6cbd-8981-4073-a0e9-07ca9570da50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.641636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6cbd-8981-4073-a0e9-07ca9570da50 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.642087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6cbd-8981-4073-a0e9-07ca9570da50 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.642524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17d6cbd-8981-4073-a0e9-07ca9570da50 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.643401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d6cbd-8981-4073-a0e9-07ca9570da50 None admin] RBAC: Adding query filter params (name=member) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:40.643872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d6cbd-8981-4073-a0e9-07ca9570da50 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.645456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17d6cbd-8981-4073-a0e9-07ca9570da50 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.655071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 217/441] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:40.660719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d6cbd-8981-4073-a0e9-07ca9570da50 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:40.726019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:40.763713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a011091a-9085-40ff-b1f4-4e79f145da02 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.785753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17d6cbd-8981-4073-a0e9-07ca9570da50 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:40.802685 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:40.807555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26fca-7cd3-4108-b120-fdcd512b2173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.808452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26fca-7cd3-4108-b120-fdcd512b2173 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.808753 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26fca-7cd3-4108-b120-fdcd512b2173 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.809018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f26fca-7cd3-4108-b120-fdcd512b2173 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.822185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869a80b-48b8-4caa-a966-861d68d7773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:40.822820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869a80b-48b8-4caa-a966-861d68d7773f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:40.823105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869a80b-48b8-4caa-a966-861d68d7773f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:40.823376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4869a80b-48b8-4caa-a966-861d68d7773f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:40.878705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f26fca-7cd3-4108-b120-fdcd512b2173 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.880204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f26fca-7cd3-4108-b120-fdcd512b2173 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.897655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869a80b-48b8-4caa-a966-861d68d7773f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:40.899487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4869a80b-48b8-4caa-a966-861d68d7773f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:40.951952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:40.984176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 225/442] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:40.989676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26fca-7cd3-4108-b120-fdcd512b2173 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.003944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 218/443] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:52:41.004792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869a80b-48b8-4caa-a966-861d68d7773f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.025481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:41.093701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f26fca-7cd3-4108-b120-fdcd512b2173 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.107816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4869a80b-48b8-4caa-a966-861d68d7773f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.131880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a99dd-866f-4229-bbee-558cc0f1ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.132518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a99dd-866f-4229-bbee-558cc0f1ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.132794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a99dd-866f-4229-bbee-558cc0f1ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.133094 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5a99dd-866f-4229-bbee-558cc0f1ebe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.143885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf414c40-b682-448d-9a04-ef04a81c643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.144379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5a99dd-866f-4229-bbee-558cc0f1ebe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:41.144558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf414c40-b682-448d-9a04-ef04a81c643e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.144781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf414c40-b682-448d-9a04-ef04a81c643e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.145049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf414c40-b682-448d-9a04-ef04a81c643e None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.146499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf414c40-b682-448d-9a04-ef04a81c643e None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:41.147997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf414c40-b682-448d-9a04-ef04a81c643e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-3f5a99dd-866f-4229-bbee-558cc0f1ebe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:41.149430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:41.150308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:52:41.155489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:41.157843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 219/444] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:41.157843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf414c40-b682-448d-9a04-ef04a81c643e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.158001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 226/445] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:41.158001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a99dd-866f-4229-bbee-558cc0f1ebe9 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.188729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:41.241712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:41.258693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf414c40-b682-448d-9a04-ef04a81c643e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.258901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5a99dd-866f-4229-bbee-558cc0f1ebe9 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.294526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb80951-3406-4eb7-be11-1693e70ea9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.295158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53004241-52a2-411a-9890-5b32baf74525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.295272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb80951-3406-4eb7-be11-1693e70ea9c8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.295446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb80951-3406-4eb7-be11-1693e70ea9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.295715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb80951-3406-4eb7-be11-1693e70ea9c8 None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.295804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53004241-52a2-411a-9890-5b32baf74525 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.296040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53004241-52a2-411a-9890-5b32baf74525 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.296303 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53004241-52a2-411a-9890-5b32baf74525 None admin] PATH_INFO: `/v3/projects/1e153a5d02af48acaf1b20217342aed9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.296823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb80951-3406-4eb7-be11-1693e70ea9c8 None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:41.297511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53004241-52a2-411a-9890-5b32baf74525 None admin] RBAC: Authorizing `identity:get_project(project_id=1e153a5d02af48acaf1b20217342aed9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:41.298262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb80951-3406-4eb7-be11-1693e70ea9c8 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:41.298975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53004241-52a2-411a-9890-5b32baf74525 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:41.299894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 227/446] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:41.300643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb80951-3406-4eb7-be11-1693e70ea9c8 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.303590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 220/447] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/projects/1e153a5d02af48acaf1b20217342aed9 => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:41.309408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53004241-52a2-411a-9890-5b32baf74525 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.399356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:41.403413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb80951-3406-4eb7-be11-1693e70ea9c8 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.409283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53004241-52a2-411a-9890-5b32baf74525 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.437383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7862b2-1aaf-40f8-b8af-27ad469b208f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.437981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7862b2-1aaf-40f8-b8af-27ad469b208f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.438257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7862b2-1aaf-40f8-b8af-27ad469b208f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.438522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7862b2-1aaf-40f8-b8af-27ad469b208f None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.439218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7862b2-1aaf-40f8-b8af-27ad469b208f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:41.439521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7862b2-1aaf-40f8-b8af-27ad469b208f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:41.440899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7862b2-1aaf-40f8-b8af-27ad469b208f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:41.442599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc553500-e5b2-4c55-94e9-783d9a828c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.443253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553500-e5b2-4c55-94e9-783d9a828c2b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.443559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553500-e5b2-4c55-94e9-783d9a828c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.443831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc553500-e5b2-4c55-94e9-783d9a828c2b None admin] PATH_INFO: `/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.444951 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc553500-e5b2-4c55-94e9-783d9a828c2b None admin] RBAC: Authorizing `identity:get_group(group_id=8a1b82a8b4dd44b2a3291763e713ba41)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:41.446395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc553500-e5b2-4c55-94e9-783d9a828c2b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:41.447998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 221/448] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/groups/8a1b82a8b4dd44b2a3291763e713ba41 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:41.448824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc553500-e5b2-4c55-94e9-783d9a828c2b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.449561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 228/449] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:41.454676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7862b2-1aaf-40f8-b8af-27ad469b208f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.473060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:41.553499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc553500-e5b2-4c55-94e9-783d9a828c2b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.556016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7862b2-1aaf-40f8-b8af-27ad469b208f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.586975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c0a1a-dcc5-46dd-ac24-ced1401a9e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.587571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c0a1a-dcc5-46dd-ac24-ced1401a9e76 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.587843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c0a1a-dcc5-46dd-ac24-ced1401a9e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.588106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2c0a1a-dcc5-46dd-ac24-ced1401a9e76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.588820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c0a1a-dcc5-46dd-ac24-ced1401a9e76 None admin] RBAC: Adding query filter params (group.id=8a1b82a8b4dd44b2a3291763e713ba41, role.id=17053af642bb46de91cf75f9be9d458a, scope.project.id=1e153a5d02af48acaf1b20217342aed9) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:41.589160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c0a1a-dcc5-46dd-ac24-ced1401a9e76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:41.589300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de137-2eef-46cb-a23f-2d65aa426b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.590360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de137-2eef-46cb-a23f-2d65aa426b3e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.590642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de137-2eef-46cb-a23f-2d65aa426b3e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.590733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2c0a1a-dcc5-46dd-ac24-ced1401a9e76 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:41.590940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5de137-2eef-46cb-a23f-2d65aa426b3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.591668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de137-2eef-46cb-a23f-2d65aa426b3e None admin] RBAC: Adding query filter params (group.id=8a1b82a8b4dd44b2a3291763e713ba41, role.id=fc85aab66ae3471dbebf6a8340dbd444, scope.project.id=1e153a5d02af48acaf1b20217342aed9) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:41.591978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de137-2eef-46cb-a23f-2d65aa426b3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:41.593421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5de137-2eef-46cb-a23f-2d65aa426b3e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:41.596571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 222/450] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/role_assignments?group.id=8a1b82a8b4dd44b2a3291763e713ba41&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=17053af642bb46de91cf75f9be9d458a => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:41.597255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c0a1a-dcc5-46dd-ac24-ced1401a9e76 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.606932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 229/451] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/role_assignments?group.id=8a1b82a8b4dd44b2a3291763e713ba41&scope.project.id=1e153a5d02af48acaf1b20217342aed9&role.id=fc85aab66ae3471dbebf6a8340dbd444 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:41.712585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:41.734202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2c0a1a-dcc5-46dd-ac24-ced1401a9e76 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:41.780060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01110c7d-181b-44d5-9697-c3ad6bdf5f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:41.780667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01110c7d-181b-44d5-9697-c3ad6bdf5f58 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:41.780944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01110c7d-181b-44d5-9697-c3ad6bdf5f58 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:41.781215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01110c7d-181b-44d5-9697-c3ad6bdf5f58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:41.852585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01110c7d-181b-44d5-9697-c3ad6bdf5f58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:41.854034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01110c7d-181b-44d5-9697-c3ad6bdf5f58 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:41.941220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:41.958847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 223/452] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:41.964918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de137-2eef-46cb-a23f-2d65aa426b3e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:41.995049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:42.072937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5de137-2eef-46cb-a23f-2d65aa426b3e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:42.110528 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613404b-6a9a-47d7-a84c-b3642b2c7249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:42.111135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613404b-6a9a-47d7-a84c-b3642b2c7249 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:42.111410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613404b-6a9a-47d7-a84c-b3642b2c7249 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:42.111675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8613404b-6a9a-47d7-a84c-b3642b2c7249 None admin] PATH_INFO: `/v3/projects/4e6b4204a03c4768887ce19cd521bf6b` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:42.113004 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613404b-6a9a-47d7-a84c-b3642b2c7249 None admin] RBAC: Authorizing `identity:get_project(project_id=4e6b4204a03c4768887ce19cd521bf6b)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:42.114515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8613404b-6a9a-47d7-a84c-b3642b2c7249 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:42.116225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 230/453] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:52:41 2022] GET /identity/v3/projects/4e6b4204a03c4768887ce19cd521bf6b => generated 344 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:42.122361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01110c7d-181b-44d5-9697-c3ad6bdf5f58 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:42.245041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01110c7d-181b-44d5-9697-c3ad6bdf5f58 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:42.281202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427cd7d-9ea8-412c-8f26-97bb84fdb7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:42.281818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427cd7d-9ea8-412c-8f26-97bb84fdb7d1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:42.282091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427cd7d-9ea8-412c-8f26-97bb84fdb7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:42.282358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427cd7d-9ea8-412c-8f26-97bb84fdb7d1 None admin] PATH_INFO: `/v3/groups/6debd54ee8494d539af5e5c640c78245` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:42.283584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427cd7d-9ea8-412c-8f26-97bb84fdb7d1 None admin] RBAC: Authorizing `identity:get_group(group_id=6debd54ee8494d539af5e5c640c78245)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:42.285062 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427cd7d-9ea8-412c-8f26-97bb84fdb7d1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:42.286620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 224/454] 10.222.0.59 () {56 vars in 1180 bytes} [Thu Aug 18 20:52:42 2022] GET /identity/v3/groups/6debd54ee8494d539af5e5c640c78245 => generated 229 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:42.293358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613404b-6a9a-47d7-a84c-b3642b2c7249 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:42.395429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:42.403705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8613404b-6a9a-47d7-a84c-b3642b2c7249 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:42.442729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5505bf25-aafa-48e1-a23e-396db0d4f043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:42.443366 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505bf25-aafa-48e1-a23e-396db0d4f043 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:42.443646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505bf25-aafa-48e1-a23e-396db0d4f043 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:42.443919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5505bf25-aafa-48e1-a23e-396db0d4f043 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:42.444643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505bf25-aafa-48e1-a23e-396db0d4f043 None admin] RBAC: Adding query filter params (group.id=6debd54ee8494d539af5e5c640c78245, role.id=85a146946817410b9a3addcf041c5909, scope.project.id=4e6b4204a03c4768887ce19cd521bf6b) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:42.444950 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505bf25-aafa-48e1-a23e-396db0d4f043 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:42.446377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5505bf25-aafa-48e1-a23e-396db0d4f043 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:42.452464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 231/455] 10.222.0.59 () {56 vars in 1376 bytes} [Thu Aug 18 20:52:42 2022] GET /identity/v3/role_assignments?group.id=6debd54ee8494d539af5e5c640c78245&scope.project.id=4e6b4204a03c4768887ce19cd521bf6b&role.id=85a146946817410b9a3addcf041c5909 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:44.712031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081b62f-8d12-412c-95d0-14812550a902 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.713033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081b62f-8d12-412c-95d0-14812550a902 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.713530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081b62f-8d12-412c-95d0-14812550a902 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.715477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 225/456] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:44.720720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551ec9-ba8c-4825-83de-cd865f90d39f None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.721134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551ec9-ba8c-4825-83de-cd865f90d39f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.721261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab551ec9-ba8c-4825-83de-cd865f90d39f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.751630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ab551ec9-ba8c-4825-83de-cd865f90d39f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:44.753059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ab551ec9-ba8c-4825-83de-cd865f90d39f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:44.848067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 232/457] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:44.890823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a8f67-035d-48b1-a437-2adbba7c54be None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.891438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a8f67-035d-48b1-a437-2adbba7c54be None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.891932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266a8f67-035d-48b1-a437-2adbba7c54be None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.893716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 226/458] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:44.899428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d162623-dcdc-4fb4-8b0d-621e0376c5dc None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:44.899717 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d162623-dcdc-4fb4-8b0d-621e0376c5dc None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:44.899994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d162623-dcdc-4fb4-8b0d-621e0376c5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:44.928191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-1d162623-dcdc-4fb4-8b0d-621e0376c5dc None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:44.929389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-1d162623-dcdc-4fb4-8b0d-621e0376c5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:45.021677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 233/459] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:45.110816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04056cdd-eaba-4b23-b8ab-4b877fd2465c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.110816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04056cdd-eaba-4b23-b8ab-4b877fd2465c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.110816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04056cdd-eaba-4b23-b8ab-4b877fd2465c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.111522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 227/460] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:45.117170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab0a47-4775-4f9a-a130-8c2753ef1d30 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.117462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab0a47-4775-4f9a-a130-8c2753ef1d30 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.117749 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eab0a47-4775-4f9a-a130-8c2753ef1d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.134326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04056cdd-eaba-4b23-b8ab-4b877fd2465c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.141865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-2eab0a47-4775-4f9a-a130-8c2753ef1d30 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:45.143077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2eab0a47-4775-4f9a-a130-8c2753ef1d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:45.158780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.236825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.248226 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 234/461] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:45.303165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04056cdd-eaba-4b23-b8ab-4b877fd2465c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.359515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c963092-3284-49cb-97f7-d4a24840d13b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.360535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963092-3284-49cb-97f7-d4a24840d13b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.361038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963092-3284-49cb-97f7-d4a24840d13b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.361524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c963092-3284-49cb-97f7-d4a24840d13b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.373412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c963092-3284-49cb-97f7-d4a24840d13b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.375220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c963092-3284-49cb-97f7-d4a24840d13b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9c963092-3284-49cb-97f7-d4a24840d13b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:45.393711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:45.394655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:45.395535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:45.395535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:45.395535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:45.397885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 228/462] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:45.403656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab0a47-4775-4f9a-a130-8c2753ef1d30 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.478616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c963092-3284-49cb-97f7-d4a24840d13b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.514371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eab0a47-4775-4f9a-a130-8c2753ef1d30 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.552024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06fa8-90b0-4cb8-a423-c1a29d6f2d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.552881 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06fa8-90b0-4cb8-a423-c1a29d6f2d3c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.553356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06fa8-90b0-4cb8-a423-c1a29d6f2d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.553768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe06fa8-90b0-4cb8-a423-c1a29d6f2d3c None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.554576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06fa8-90b0-4cb8-a423-c1a29d6f2d3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:45.555049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06fa8-90b0-4cb8-a423-c1a29d6f2d3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.556684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe06fa8-90b0-4cb8-a423-c1a29d6f2d3c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.569664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 235/463] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:45.575625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06fa8-90b0-4cb8-a423-c1a29d6f2d3c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.588823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.665686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c963092-3284-49cb-97f7-d4a24840d13b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.669604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.720283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe06fa8-90b0-4cb8-a423-c1a29d6f2d3c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.725284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24b1db-d3d4-44b0-b5a5-1386e7a4cc40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.725918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b1db-d3d4-44b0-b5a5-1386e7a4cc40 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.726192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b1db-d3d4-44b0-b5a5-1386e7a4cc40 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.726458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c24b1db-d3d4-44b0-b5a5-1386e7a4cc40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.737490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24b1db-d3d4-44b0-b5a5-1386e7a4cc40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.739288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c24b1db-d3d4-44b0-b5a5-1386e7a4cc40 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6c24b1db-d3d4-44b0-b5a5-1386e7a4cc40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:45.753562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:45.754519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:45.755680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:45.755680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:45.755680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:45.755839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713233a-4962-4d82-82e2-1fd2ef1e6d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.755839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713233a-4962-4d82-82e2-1fd2ef1e6d0b None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.756300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 229/464] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:45.756368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713233a-4962-4d82-82e2-1fd2ef1e6d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.756368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713233a-4962-4d82-82e2-1fd2ef1e6d0b None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.756482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24b1db-d3d4-44b0-b5a5-1386e7a4cc40 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.756575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713233a-4962-4d82-82e2-1fd2ef1e6d0b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.757424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713233a-4962-4d82-82e2-1fd2ef1e6d0b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.785407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 236/465] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:45 2022] POST /identity/v3/users => generated 246 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:45.785407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068670f-f258-466a-9832-f5c8a8738a51 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.785407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068670f-f258-466a-9832-f5c8a8738a51 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.785407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d068670f-f258-466a-9832-f5c8a8738a51 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.785407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 237/466] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:45.785407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068670f-f258-466a-9832-f5c8a8738a51 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:45.878600 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:45.898709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c24b1db-d3d4-44b0-b5a5-1386e7a4cc40 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.928424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d068670f-f258-466a-9832-f5c8a8738a51 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:45.945746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4bfaac-1af0-4155-b22c-ee73d02bd67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.946653 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bfaac-1af0-4155-b22c-ee73d02bd67d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.946960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bfaac-1af0-4155-b22c-ee73d02bd67d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.947223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4bfaac-1af0-4155-b22c-ee73d02bd67d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.962574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bfaac-1af0-4155-b22c-ee73d02bd67d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.964229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4bfaac-1af0-4155-b22c-ee73d02bd67d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.974504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a319-99dd-4119-9cd9-78ab3052d6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:45.975426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a319-99dd-4119-9cd9-78ab3052d6ee None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.975710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a319-99dd-4119-9cd9-78ab3052d6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.975982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2588a319-99dd-4119-9cd9-78ab3052d6ee None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.976638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588a319-99dd-4119-9cd9-78ab3052d6ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:45.976938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588a319-99dd-4119-9cd9-78ab3052d6ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:45.978315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2588a319-99dd-4119-9cd9-78ab3052d6ee None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4d4bfaac-1af0-4155-b22c-ee73d02bd67d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:45.981135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:45.982007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:45.982905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:45.982905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:45.982905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:45.982905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 230/467] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:45.983139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc721e52-07da-48ed-ad8e-a281a7188cf2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:45.983616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc721e52-07da-48ed-ad8e-a281a7188cf2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:45.983616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc721e52-07da-48ed-ad8e-a281a7188cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:45.996488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 238/468] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:45.997438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a319-99dd-4119-9cd9-78ab3052d6ee None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.005002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fc721e52-07da-48ed-ad8e-a281a7188cf2 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:46.006210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fc721e52-07da-48ed-ad8e-a281a7188cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:46.008573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.093049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 231/469] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:46.093911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc721e52-07da-48ed-ad8e-a281a7188cf2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.140182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2588a319-99dd-4119-9cd9-78ab3052d6ee None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.167642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.183090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8075f-5e7d-4000-8ebd-3e345c90d855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.183965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8075f-5e7d-4000-8ebd-3e345c90d855 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.184300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8075f-5e7d-4000-8ebd-3e345c90d855 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.184582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a8075f-5e7d-4000-8ebd-3e345c90d855 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.185237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8075f-5e7d-4000-8ebd-3e345c90d855 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:46.185541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8075f-5e7d-4000-8ebd-3e345c90d855 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.194797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a8075f-5e7d-4000-8ebd-3e345c90d855 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.201499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 239/470] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:46.207178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8075f-5e7d-4000-8ebd-3e345c90d855 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.319685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a8075f-5e7d-4000-8ebd-3e345c90d855 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.356097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc721e52-07da-48ed-ad8e-a281a7188cf2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.361669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f26ac7-2989-474b-8b68-fa8f540f03b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.362291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f26ac7-2989-474b-8b68-fa8f540f03b1 None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.362566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f26ac7-2989-474b-8b68-fa8f540f03b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.362865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f26ac7-2989-474b-8b68-fa8f540f03b1 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.363529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f26ac7-2989-474b-8b68-fa8f540f03b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.364968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f26ac7-2989-474b-8b68-fa8f540f03b1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.391343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 240/471] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/users => generated 248 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:46.406591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f26ac7-2989-474b-8b68-fa8f540f03b1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.442940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7f8276-bfa2-45aa-9571-5040655b72f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.445275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8276-bfa2-45aa-9571-5040655b72f7 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.447154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8276-bfa2-45aa-9571-5040655b72f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.447554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7f8276-bfa2-45aa-9571-5040655b72f7 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.448228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f8276-bfa2-45aa-9571-5040655b72f7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.451204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7f8276-bfa2-45aa-9571-5040655b72f7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.473668 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.486282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.496844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 232/472] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/users => generated 248 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:46.562358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f26ac7-2989-474b-8b68-fa8f540f03b1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.604558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b045-6c49-448a-b4a1-b4f315a3f6ef None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.604558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b045-6c49-448a-b4a1-b4f315a3f6ef None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.604926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221b045-6c49-448a-b4a1-b4f315a3f6ef None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.606855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 233/473] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:46.607573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc7232-1469-4aa9-a73c-8630cfc86553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.608412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc7232-1469-4aa9-a73c-8630cfc86553 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.608935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc7232-1469-4aa9-a73c-8630cfc86553 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.609333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc7232-1469-4aa9-a73c-8630cfc86553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.612997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a72c7-f5ce-4d23-be51-cd4212ee6355 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.612997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a72c7-f5ce-4d23-be51-cd4212ee6355 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.613366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8a72c7-f5ce-4d23-be51-cd4212ee6355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.625525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc7232-1469-4aa9-a73c-8630cfc86553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.628850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc7232-1469-4aa9-a73c-8630cfc86553 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.634147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-af8a72c7-f5ce-4d23-be51-cd4212ee6355 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:46.635539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-af8a72c7-f5ce-4d23-be51-cd4212ee6355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-6efc7232-1469-4aa9-a73c-8630cfc86553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:46.648090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:46.649303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:46.650404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:46.650404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:46.650404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:46.652491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 241/474] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:46.658690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc7232-1469-4aa9-a73c-8630cfc86553 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.713659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 234/475] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:46.762812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.780600 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc7232-1469-4aa9-a73c-8630cfc86553 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.822838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705b9e6-c7b0-4ea6-afe2-0aa38ad0ac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.823870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705b9e6-c7b0-4ea6-afe2-0aa38ad0ac9f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.824316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705b9e6-c7b0-4ea6-afe2-0aa38ad0ac9f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.824786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0705b9e6-c7b0-4ea6-afe2-0aa38ad0ac9f None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.825447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705b9e6-c7b0-4ea6-afe2-0aa38ad0ac9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:46.825750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705b9e6-c7b0-4ea6-afe2-0aa38ad0ac9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.827208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0705b9e6-c7b0-4ea6-afe2-0aa38ad0ac9f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:46.841020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 242/476] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:46.846889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a72c7-f5ce-4d23-be51-cd4212ee6355 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:46.954551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8a72c7-f5ce-4d23-be51-cd4212ee6355 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:46.988306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:46.993815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ead6db-09a0-4ccc-acdb-5f8718f6a616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:46.994669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ead6db-09a0-4ccc-acdb-5f8718f6a616 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:46.995206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ead6db-09a0-4ccc-acdb-5f8718f6a616 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:46.995890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ead6db-09a0-4ccc-acdb-5f8718f6a616 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:46.996785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ead6db-09a0-4ccc-acdb-5f8718f6a616 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:46.998849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ead6db-09a0-4ccc-acdb-5f8718f6a616 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.023781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 235/477] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:46 2022] POST /identity/v3/users => generated 249 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:52:47.033049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705b9e6-c7b0-4ea6-afe2-0aa38ad0ac9f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.190887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0705b9e6-c7b0-4ea6-afe2-0aa38ad0ac9f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.228367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993eafc-3d36-47a4-9bf7-a96e46a4fcd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.229244 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993eafc-3d36-47a4-9bf7-a96e46a4fcd7 None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.229710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993eafc-3d36-47a4-9bf7-a96e46a4fcd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.230118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a993eafc-3d36-47a4-9bf7-a96e46a4fcd7 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.230961 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993eafc-3d36-47a4-9bf7-a96e46a4fcd7 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.232487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a993eafc-3d36-47a4-9bf7-a96e46a4fcd7 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.242392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.sql.core [None req-a993eafc-3d36-47a4-9bf7-a96e46a4fcd7 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 20:52:47.242392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 20:52:47.242392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [parameters: {'id': '251cf1e793674d38a8ff8dee4b1d05df', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 20:52:47.242392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81587) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-a993eafc-3d36-47a4-9bf7-a96e46a4fcd7 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application result.read() Aug 18 20:52:47.259557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return ref.to_dict() Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:52:47.260663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application yield resource Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise self.value Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application session.commit() Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:52:47.261945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:52:47.263046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:52:47.264302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application result.read() Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:52:47.265500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [parameters: {'id': '251cf1e793674d38a8ff8dee4b1d05df', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:47.266543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 18 20:52:47.267557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:47.270575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 243/478] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Aug 18 20:52:47 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:47.276409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ead6db-09a0-4ccc-acdb-5f8718f6a616 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.393963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ead6db-09a0-4ccc-acdb-5f8718f6a616 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.430214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c321b6-a015-46db-bba3-0e814293ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.431201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c321b6-a015-46db-bba3-0e814293ac1c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.431690 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c321b6-a015-46db-bba3-0e814293ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.432129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c321b6-a015-46db-bba3-0e814293ac1c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.443745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c321b6-a015-46db-bba3-0e814293ac1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e9c321b6-a015-46db-bba3-0e814293ac1c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:47.449295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:47.450258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 18 20:52:47.451094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:47.453519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 236/479] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:47.459006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993eafc-3d36-47a4-9bf7-a96e46a4fcd7 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:47.487900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:47.589450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a993eafc-3d36-47a4-9bf7-a96e46a4fcd7 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:47.640360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d24b31-a83f-42b0-a3c6-2a23f0c5a3f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:47.641260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24b31-a83f-42b0-a3c6-2a23f0c5a3f7 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.641680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24b31-a83f-42b0-a3c6-2a23f0c5a3f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:47.642089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d24b31-a83f-42b0-a3c6-2a23f0c5a3f7 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:47.642929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d24b31-a83f-42b0-a3c6-2a23f0c5a3f7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:47.643385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d24b31-a83f-42b0-a3c6-2a23f0c5a3f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:47.644936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d24b31-a83f-42b0-a3c6-2a23f0c5a3f7 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:47.658915 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 244/480] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:47.998593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302f666-cfbf-4f2c-9810-c36c223be78f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:47.999636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302f666-cfbf-4f2c-9810-c36c223be78f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.000133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8302f666-cfbf-4f2c-9810-c36c223be78f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.001958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 237/481] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:48.007083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f3b18-894a-4ccc-893f-09c3e6b280dd None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.007496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f3b18-894a-4ccc-893f-09c3e6b280dd None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.007668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26f3b18-894a-4ccc-893f-09c3e6b280dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.029629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d26f3b18-894a-4ccc-893f-09c3e6b280dd None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:48.030761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d26f3b18-894a-4ccc-893f-09c3e6b280dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:48.102331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 245/482] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:48.379094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302f666-cfbf-4f2c-9810-c36c223be78f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:48.444473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:48.516443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8302f666-cfbf-4f2c-9810-c36c223be78f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:48.561867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08549966-dcad-4c0e-99ac-de50f6177199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.562504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08549966-dcad-4c0e-99ac-de50f6177199 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.562792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08549966-dcad-4c0e-99ac-de50f6177199 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.563077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08549966-dcad-4c0e-99ac-de50f6177199 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.583191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08549966-dcad-4c0e-99ac-de50f6177199 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-08549966-dcad-4c0e-99ac-de50f6177199 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:48.588586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:48.589692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:48.590927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 238/483] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:48.596064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f3b18-894a-4ccc-893f-09c3e6b280dd None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:48.608179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:48.725599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26f3b18-894a-4ccc-893f-09c3e6b280dd None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:48.774688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9b9b9-23eb-4534-859f-9e00373aced9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.775371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b9b9-23eb-4534-859f-9e00373aced9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.776113 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b9b9-23eb-4534-859f-9e00373aced9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.776113 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9b9b9-23eb-4534-859f-9e00373aced9 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.776619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9b9b9-23eb-4534-859f-9e00373aced9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:48.777035 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9b9b9-23eb-4534-859f-9e00373aced9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:48.778718 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9b9b9-23eb-4534-859f-9e00373aced9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:48.787161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 246/484] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:52:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:48.792841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08549966-dcad-4c0e-99ac-de50f6177199 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:48.900431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:48.911127 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08549966-dcad-4c0e-99ac-de50f6177199 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:48.964705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d83dc2-4a50-4de2-b124-6b71a04d4cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:48.965356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d83dc2-4a50-4de2-b124-6b71a04d4cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:48.965633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d83dc2-4a50-4de2-b124-6b71a04d4cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:48.965904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d83dc2-4a50-4de2-b124-6b71a04d4cb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:48.989330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d83dc2-4a50-4de2-b124-6b71a04d4cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:48.990750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d83dc2-4a50-4de2-b124-6b71a04d4cb8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-26d83dc2-4a50-4de2-b124-6b71a04d4cb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:49.024393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:49.025774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:49.027425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:49.027425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:49.027425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:49.027425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 239/485] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:49.036283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9b9b9-23eb-4534-859f-9e00373aced9 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:49.050844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbb66-bfc0-4a68-bc26-79de4059444b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.051131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbb66-bfc0-4a68-bc26-79de4059444b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.051407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6bbb66-bfc0-4a68-bc26-79de4059444b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.054437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 240/486] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:49.062616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe028-165d-4efb-bf95-81a593d04b6d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.063949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe028-165d-4efb-bf95-81a593d04b6d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.063949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8febe028-165d-4efb-bf95-81a593d04b6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.097901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8febe028-165d-4efb-bf95-81a593d04b6d None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:49.099473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8febe028-165d-4efb-bf95-81a593d04b6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:49.189940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 241/487] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:49.196606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:49.226446 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a496-1e83-4f57-8db1-86c8a3d3b1fb None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.226805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a496-1e83-4f57-8db1-86c8a3d3b1fb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.227559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4420a496-1e83-4f57-8db1-86c8a3d3b1fb None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.228624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 242/488] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:52:49.233834 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a54bec-4890-4262-ada6-88153efd397c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.234114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a54bec-4890-4262-ada6-88153efd397c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.237014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a54bec-4890-4262-ada6-88153efd397c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.264242 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c2a54bec-4890-4262-ada6-88153efd397c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:49.266074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c2a54bec-4890-4262-ada6-88153efd397c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:49.272605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9b9b9-23eb-4534-859f-9e00373aced9 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:49.358795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7c649-38e9-4d41-84bb-5e30608deccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:49.358795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7c649-38e9-4d41-84bb-5e30608deccd None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.358795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7c649-38e9-4d41-84bb-5e30608deccd None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.358795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e7c649-38e9-4d41-84bb-5e30608deccd None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.359197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7c649-38e9-4d41-84bb-5e30608deccd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:49.359197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7c649-38e9-4d41-84bb-5e30608deccd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:49.362790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e7c649-38e9-4d41-84bb-5e30608deccd None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:49.402023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 247/489] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:49.404756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7c649-38e9-4d41-84bb-5e30608deccd None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:49.460538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 243/490] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:52:49.501142 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a54bec-4890-4262-ada6-88153efd397c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:49.516984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:49.624815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e7c649-38e9-4d41-84bb-5e30608deccd None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:49.642606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a54bec-4890-4262-ada6-88153efd397c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:49.698933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02008042-4ed0-4b22-b61d-459e64438b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:49.700184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02008042-4ed0-4b22-b61d-459e64438b83 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.700688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02008042-4ed0-4b22-b61d-459e64438b83 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.701339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02008042-4ed0-4b22-b61d-459e64438b83 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.713788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02008042-4ed0-4b22-b61d-459e64438b83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-02008042-4ed0-4b22-b61d-459e64438b83 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:49.719775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:49.720658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:49.721455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:49.724271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 244/491] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:49.730678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02008042-4ed0-4b22-b61d-459e64438b83 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:49.736735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:49.749984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c9580-c4e7-4688-8b21-9f36c274392e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:49.751498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9580-c4e7-4688-8b21-9f36c274392e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.751979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9580-c4e7-4688-8b21-9f36c274392e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.752460 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c9580-c4e7-4688-8b21-9f36c274392e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.772547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c9580-c4e7-4688-8b21-9f36c274392e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:49.778976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0c9580-c4e7-4688-8b21-9f36c274392e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-aa0c9580-c4e7-4688-8b21-9f36c274392e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:52:49.800476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:49.801429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:49.802328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 248/492] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Aug 18 20:52:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 398 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:49.807590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d102-b802-4b66-9944-3e851131d701 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.807941 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d102-b802-4b66-9944-3e851131d701 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.808258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4d102-b802-4b66-9944-3e851131d701 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.809785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 249/493] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:49.813897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4d102-b802-4b66-9944-3e851131d701 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:49.843250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:49.874549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02008042-4ed0-4b22-b61d-459e64438b83 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:49.911938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf621632-24dd-42d3-9a91-90592ea6f99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:49.912963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621632-24dd-42d3-9a91-90592ea6f99a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.913260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621632-24dd-42d3-9a91-90592ea6f99a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.913528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf621632-24dd-42d3-9a91-90592ea6f99a None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.914240 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf621632-24dd-42d3-9a91-90592ea6f99a None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:49.914532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf621632-24dd-42d3-9a91-90592ea6f99a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:49.915961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf621632-24dd-42d3-9a91-90592ea6f99a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:49.924174 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 245/494] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:52:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:49.925354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cbc4-48db-4321-8329-c73285cacb1e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.925633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cbc4-48db-4321-8329-c73285cacb1e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.925902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d08cbc4-48db-4321-8329-c73285cacb1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.930249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4d102-b802-4b66-9944-3e851131d701 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:49.945282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0d08cbc4-48db-4321-8329-c73285cacb1e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:49.946480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0d08cbc4-48db-4321-8329-c73285cacb1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:49.967770 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dafd51-c16a-4328-bcb8-cc0b9ce57560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:49.968632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dafd51-c16a-4328-bcb8-cc0b9ce57560 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:49.969048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dafd51-c16a-4328-bcb8-cc0b9ce57560 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:49.969474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dafd51-c16a-4328-bcb8-cc0b9ce57560 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:49.970543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dafd51-c16a-4328-bcb8-cc0b9ce57560 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:49.970884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dafd51-c16a-4328-bcb8-cc0b9ce57560 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:49.972340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dafd51-c16a-4328-bcb8-cc0b9ce57560 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.016774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 250/495] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Aug 18 20:52:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:50.016774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dafd51-c16a-4328-bcb8-cc0b9ce57560 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.024351 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 246/496] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:50.030898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08cbc4-48db-4321-8329-c73285cacb1e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.063957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.117683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dafd51-c16a-4328-bcb8-cc0b9ce57560 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.123389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.160540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d08cbc4-48db-4321-8329-c73285cacb1e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.165162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8deaf-5e11-44cb-b33e-394a79815669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.165875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8deaf-5e11-44cb-b33e-394a79815669 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.166219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8deaf-5e11-44cb-b33e-394a79815669 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.166557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8deaf-5e11-44cb-b33e-394a79815669 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.180456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8deaf-5e11-44cb-b33e-394a79815669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-54e8deaf-5e11-44cb-b33e-394a79815669 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:50.187075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:50.187984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:50.188772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:50.189359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 251/497] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:50.190670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8deaf-5e11-44cb-b33e-394a79815669 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.197401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c1b5c-e95b-43d8-8612-7d2fa8b8e4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.198037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c1b5c-e95b-43d8-8612-7d2fa8b8e4cc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.198315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c1b5c-e95b-43d8-8612-7d2fa8b8e4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.198746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c1b5c-e95b-43d8-8612-7d2fa8b8e4cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.210130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c1b5c-e95b-43d8-8612-7d2fa8b8e4cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.211799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c1b5c-e95b-43d8-8612-7d2fa8b8e4cc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-456c1b5c-e95b-43d8-8612-7d2fa8b8e4cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:50.228869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:50.230074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:50.231082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:50.231082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:50.231082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:50.234947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 247/498] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:50.235927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c1b5c-e95b-43d8-8612-7d2fa8b8e4cc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.320371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8deaf-5e11-44cb-b33e-394a79815669 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.330458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.349403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c1b5c-e95b-43d8-8612-7d2fa8b8e4cc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.357063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbc31-e4dd-49ad-b9dc-f8ac9680bda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.357670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbc31-e4dd-49ad-b9dc-f8ac9680bda0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.357942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbc31-e4dd-49ad-b9dc-f8ac9680bda0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.358210 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08bbc31-e4dd-49ad-b9dc-f8ac9680bda0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.366781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.385047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee293842-04e6-446b-9971-ec4abda53328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.385646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee293842-04e6-446b-9971-ec4abda53328 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.385953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee293842-04e6-446b-9971-ec4abda53328 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.386253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee293842-04e6-446b-9971-ec4abda53328 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.386912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee293842-04e6-446b-9971-ec4abda53328 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:50.387246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee293842-04e6-446b-9971-ec4abda53328 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.388641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee293842-04e6-446b-9971-ec4abda53328 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.396800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 248/499] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:50.397577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee293842-04e6-446b-9971-ec4abda53328 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.430255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bbc31-e4dd-49ad-b9dc-f8ac9680bda0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.431755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d08bbc31-e4dd-49ad-b9dc-f8ac9680bda0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.503645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee293842-04e6-446b-9971-ec4abda53328 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.533279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 252/500] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:50.534128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbc31-e4dd-49ad-b9dc-f8ac9680bda0 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.538690 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a52671-3b60-4fa8-b429-f4e635493794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.539349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52671-3b60-4fa8-b429-f4e635493794 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.539630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52671-3b60-4fa8-b429-f4e635493794 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.539905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a52671-3b60-4fa8-b429-f4e635493794 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.540548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a52671-3b60-4fa8-b429-f4e635493794 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:50.540848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a52671-3b60-4fa8-b429-f4e635493794 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.542751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a52671-3b60-4fa8-b429-f4e635493794 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.544407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.560007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 249/501] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:50.560007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf32e32-27ae-4450-ab57-7103ddef45f1 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.560007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf32e32-27ae-4450-ab57-7103ddef45f1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.560007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf32e32-27ae-4450-ab57-7103ddef45f1 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.560007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 250/502] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:50.560007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf32e32-27ae-4450-ab57-7103ddef45f1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.601152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.640711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08bbc31-e4dd-49ad-b9dc-f8ac9680bda0 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.672250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf32e32-27ae-4450-ab57-7103ddef45f1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.676654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439dc3-4dfb-4f06-b97d-0d953416b7bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.677289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439dc3-4dfb-4f06-b97d-0d953416b7bb None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.677569 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439dc3-4dfb-4f06-b97d-0d953416b7bb None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.677878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d439dc3-4dfb-4f06-b97d-0d953416b7bb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.688762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d439dc3-4dfb-4f06-b97d-0d953416b7bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-3d439dc3-4dfb-4f06-b97d-0d953416b7bb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:50.693452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:50.694329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 253/503] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:50.695361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439dc3-4dfb-4f06-b97d-0d953416b7bb None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.711805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3fdc-67f6-49e1-a508-66c35e0ff610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.712438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3fdc-67f6-49e1-a508-66c35e0ff610 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.712712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3fdc-67f6-49e1-a508-66c35e0ff610 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.712989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39b3fdc-67f6-49e1-a508-66c35e0ff610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.723811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3fdc-67f6-49e1-a508-66c35e0ff610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.725292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39b3fdc-67f6-49e1-a508-66c35e0ff610 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b39b3fdc-67f6-49e1-a508-66c35e0ff610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:50.739997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:50.741015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:50.741889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:50.741889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:50.741889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:50.741889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 251/504] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:50.741889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3fdc-67f6-49e1-a508-66c35e0ff610 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.771912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.808009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d439dc3-4dfb-4f06-b97d-0d953416b7bb None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.832031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:50.842241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb90e2-b8b2-4775-ae81-9c1995c06a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.842589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39b3fdc-67f6-49e1-a508-66c35e0ff610 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:50.842907 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb90e2-b8b2-4775-ae81-9c1995c06a40 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.843193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb90e2-b8b2-4775-ae81-9c1995c06a40 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.843482 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb90e2-b8b2-4775-ae81-9c1995c06a40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.853729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb90e2-b8b2-4775-ae81-9c1995c06a40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.855572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb90e2-b8b2-4775-ae81-9c1995c06a40 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-bfeb90e2-b8b2-4775-ae81-9c1995c06a40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:50.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:50.872402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:50.873897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:50.873897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:50.873897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:50.873897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 254/505] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:50.873897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe207e4-48ab-47e0-abba-93437f73c4e3 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.874223 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe207e4-48ab-47e0-abba-93437f73c4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.874223 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe207e4-48ab-47e0-abba-93437f73c4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.878629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c725c-db6a-4c0a-a083-2ef7ef623d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:50.879287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c725c-db6a-4c0a-a083-2ef7ef623d62 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:50.879566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c725c-db6a-4c0a-a083-2ef7ef623d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:50.879843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c725c-db6a-4c0a-a083-2ef7ef623d62 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:50.887805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c725c-db6a-4c0a-a083-2ef7ef623d62 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:50.889256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c725c-db6a-4c0a-a083-2ef7ef623d62 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:50.892027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-3fe207e4-48ab-47e0-abba-93437f73c4e3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:50.893242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3fe207e4-48ab-47e0-abba-93437f73c4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d06c725c-db6a-4c0a-a083-2ef7ef623d62 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:52:50.902146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:50.903421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 252/506] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:50.904313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c725c-db6a-4c0a-a083-2ef7ef623d62 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:50.963070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 255/507] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:50.963762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe207e4-48ab-47e0-abba-93437f73c4e3 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.009259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c725c-db6a-4c0a-a083-2ef7ef623d62 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.033100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.053699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544c7e-4755-4e5b-bf4e-decb4988d212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.054329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544c7e-4755-4e5b-bf4e-decb4988d212 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.054580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544c7e-4755-4e5b-bf4e-decb4988d212 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.054888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85544c7e-4755-4e5b-bf4e-decb4988d212 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.055938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544c7e-4755-4e5b-bf4e-decb4988d212 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:51.055938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544c7e-4755-4e5b-bf4e-decb4988d212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.057232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85544c7e-4755-4e5b-bf4e-decb4988d212 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.066332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 253/508] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:51.067016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544c7e-4755-4e5b-bf4e-decb4988d212 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.084896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.088485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe207e4-48ab-47e0-abba-93437f73c4e3 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.125472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e22f4d-93d7-46d0-acb9-19ca052ddd49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.125941 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22f4d-93d7-46d0-acb9-19ca052ddd49 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.126410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22f4d-93d7-46d0-acb9-19ca052ddd49 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.126625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e22f4d-93d7-46d0-acb9-19ca052ddd49 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.127198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e22f4d-93d7-46d0-acb9-19ca052ddd49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:51.127535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e22f4d-93d7-46d0-acb9-19ca052ddd49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.128872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15e22f4d-93d7-46d0-acb9-19ca052ddd49 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.145198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 256/509] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:51.145198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e22f4d-93d7-46d0-acb9-19ca052ddd49 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.181422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85544c7e-4755-4e5b-bf4e-decb4988d212 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.214827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fd144-7fe7-43dd-a49d-b24ac567c1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.215180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd144-7fe7-43dd-a49d-b24ac567c1e4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.215452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd144-7fe7-43dd-a49d-b24ac567c1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.215720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054fd144-7fe7-43dd-a49d-b24ac567c1e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.216356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fd144-7fe7-43dd-a49d-b24ac567c1e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:51.216651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fd144-7fe7-43dd-a49d-b24ac567c1e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.218021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054fd144-7fe7-43dd-a49d-b24ac567c1e4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.229584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 254/510] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:51.230928 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fd144-7fe7-43dd-a49d-b24ac567c1e4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.249352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e22f4d-93d7-46d0-acb9-19ca052ddd49 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.259747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.287197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e709-35f7-4427-abdd-bcd05896b44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.287810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e709-35f7-4427-abdd-bcd05896b44c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.288090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e709-35f7-4427-abdd-bcd05896b44c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.288359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d0e709-35f7-4427-abdd-bcd05896b44c None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.289118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0e709-35f7-4427-abdd-bcd05896b44c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:51.289420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0e709-35f7-4427-abdd-bcd05896b44c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.290893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d0e709-35f7-4427-abdd-bcd05896b44c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.303063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.309253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 257/511] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:51.310092 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e709-35f7-4427-abdd-bcd05896b44c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.333728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054fd144-7fe7-43dd-a49d-b24ac567c1e4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.368206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdede068-ba40-4e1d-85ab-0e0eae57eee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.368832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede068-ba40-4e1d-85ab-0e0eae57eee9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.369107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede068-ba40-4e1d-85ab-0e0eae57eee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.369379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdede068-ba40-4e1d-85ab-0e0eae57eee9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.380147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdede068-ba40-4e1d-85ab-0e0eae57eee9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.381541 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdede068-ba40-4e1d-85ab-0e0eae57eee9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-cdede068-ba40-4e1d-85ab-0e0eae57eee9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:51.397570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:51.398471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:51.399631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:51.399631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:51.399631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:51.399631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 255/512] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:51.400042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdede068-ba40-4e1d-85ab-0e0eae57eee9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.410257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d0e709-35f7-4427-abdd-bcd05896b44c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.444010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cad110-22fe-4595-bba1-f8518b4feaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.444639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cad110-22fe-4595-bba1-f8518b4feaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.444917 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cad110-22fe-4595-bba1-f8518b4feaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.445185 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cad110-22fe-4595-bba1-f8518b4feaf6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.452911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cad110-22fe-4595-bba1-f8518b4feaf6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.454354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cad110-22fe-4595-bba1-f8518b4feaf6 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-a6cad110-22fe-4595-bba1-f8518b4feaf6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:52:51.466218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:51.467151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:51.468052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 258/513] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:51.468615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cad110-22fe-4595-bba1-f8518b4feaf6 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.501843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.504790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdede068-ba40-4e1d-85ab-0e0eae57eee9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.528708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.539621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca850ea-6067-446a-ad10-97c77c78eaec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.540248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca850ea-6067-446a-ad10-97c77c78eaec None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.540521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca850ea-6067-446a-ad10-97c77c78eaec None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.541148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca850ea-6067-446a-ad10-97c77c78eaec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.551796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca850ea-6067-446a-ad10-97c77c78eaec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.553297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca850ea-6067-446a-ad10-97c77c78eaec None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6ca850ea-6067-446a-ad10-97c77c78eaec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:51.567496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:51.568513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:51.569353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:51.569353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:51.569353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:51.569353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 256/514] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:51.569353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca850ea-6067-446a-ad10-97c77c78eaec None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.577188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cad110-22fe-4595-bba1-f8518b4feaf6 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.610935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fb7a5-df01-4814-a4c1-2b741e26c9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.611595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fb7a5-df01-4814-a4c1-2b741e26c9dd None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.611870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fb7a5-df01-4814-a4c1-2b741e26c9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.612138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76fb7a5-df01-4814-a4c1-2b741e26c9dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.618671 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fb7a5-df01-4814-a4c1-2b741e26c9dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.620418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76fb7a5-df01-4814-a4c1-2b741e26c9dd None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-e76fb7a5-df01-4814-a4c1-2b741e26c9dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:52:51.632432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:51.633280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:51.634127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:52:51.634127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:52:51.634127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:52:51.634127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:52:51.634127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:52:51.634127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:52:51.634127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:51.634127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:51.634127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 259/515] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:51.634597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fb7a5-df01-4814-a4c1-2b741e26c9dd None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.673557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca850ea-6067-446a-ad10-97c77c78eaec None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.706340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3186b7e-6cb5-4730-b186-e9dbedfdbb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.706968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3186b7e-6cb5-4730-b186-e9dbedfdbb82 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.707241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3186b7e-6cb5-4730-b186-e9dbedfdbb82 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.707504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3186b7e-6cb5-4730-b186-e9dbedfdbb82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.722699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.735475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76fb7a5-df01-4814-a4c1-2b741e26c9dd None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.753572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.773446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007881-b38f-4c04-892a-a74abb2e803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.774231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007881-b38f-4c04-892a-a74abb2e803c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.774325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007881-b38f-4c04-892a-a74abb2e803c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.774592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50007881-b38f-4c04-892a-a74abb2e803c None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.775275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007881-b38f-4c04-892a-a74abb2e803c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:51.775578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007881-b38f-4c04-892a-a74abb2e803c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.777060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50007881-b38f-4c04-892a-a74abb2e803c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.779959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3186b7e-6cb5-4730-b186-e9dbedfdbb82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.781844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3186b7e-6cb5-4730-b186-e9dbedfdbb82 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.790123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 260/516] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:51.790986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007881-b38f-4c04-892a-a74abb2e803c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.885539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 257/517] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:51.886981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3186b7e-6cb5-4730-b186-e9dbedfdbb82 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.893338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50007881-b38f-4c04-892a-a74abb2e803c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:51.928500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc8c90-258b-4fd8-b8b9-7d441c0b0e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:51.929109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc8c90-258b-4fd8-b8b9-7d441c0b0e95 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:51.929384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc8c90-258b-4fd8-b8b9-7d441c0b0e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:51.929645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bdc8c90-258b-4fd8-b8b9-7d441c0b0e95 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:51.930380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc8c90-258b-4fd8-b8b9-7d441c0b0e95 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:51.930680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc8c90-258b-4fd8-b8b9-7d441c0b0e95 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:51.932155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bdc8c90-258b-4fd8-b8b9-7d441c0b0e95 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:51.949942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 261/518] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:51.950982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc8c90-258b-4fd8-b8b9-7d441c0b0e95 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:51.959233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.969412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:51.992641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3186b7e-6cb5-4730-b186-e9dbedfdbb82 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.027639 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b062965-42ed-414a-aa76-c016b610b344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.028240 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b062965-42ed-414a-aa76-c016b610b344 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.028516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b062965-42ed-414a-aa76-c016b610b344 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.028784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b062965-42ed-414a-aa76-c016b610b344 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.029429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b062965-42ed-414a-aa76-c016b610b344 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:52.029727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b062965-42ed-414a-aa76-c016b610b344 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.031157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b062965-42ed-414a-aa76-c016b610b344 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.042346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 258/519] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:52.043330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b062965-42ed-414a-aa76-c016b610b344 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.060924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bdc8c90-258b-4fd8-b8b9-7d441c0b0e95 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.095263 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075ec14-92a6-4197-b9e6-c96aa84e6057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.095925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ec14-92a6-4197-b9e6-c96aa84e6057 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.096131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ec14-92a6-4197-b9e6-c96aa84e6057 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.096414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075ec14-92a6-4197-b9e6-c96aa84e6057 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.097096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075ec14-92a6-4197-b9e6-c96aa84e6057 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:52.097398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075ec14-92a6-4197-b9e6-c96aa84e6057 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.098893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c075ec14-92a6-4197-b9e6-c96aa84e6057 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.116192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 262/520] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:52:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:52.116988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075ec14-92a6-4197-b9e6-c96aa84e6057 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.143895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b062965-42ed-414a-aa76-c016b610b344 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.179492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdb2fc-ba10-4361-864d-d61cf1d37f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.180123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdb2fc-ba10-4361-864d-d61cf1d37f87 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.180406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdb2fc-ba10-4361-864d-d61cf1d37f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.180678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cdb2fc-ba10-4361-864d-d61cf1d37f87 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.183696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.189166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdb2fc-ba10-4361-864d-d61cf1d37f87 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.190747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cdb2fc-ba10-4361-864d-d61cf1d37f87 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.199560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-75cdb2fc-ba10-4361-864d-d61cf1d37f87 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:52:52.202326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:52.203258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:52.204157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 259/521] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:52.204749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdb2fc-ba10-4361-864d-d61cf1d37f87 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.240692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075ec14-92a6-4197-b9e6-c96aa84e6057 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.274529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783780a5-e0e5-44bb-967a-d481f22567e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.275176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783780a5-e0e5-44bb-967a-d481f22567e5 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.275454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783780a5-e0e5-44bb-967a-d481f22567e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.275724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783780a5-e0e5-44bb-967a-d481f22567e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.286522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783780a5-e0e5-44bb-967a-d481f22567e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.288082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783780a5-e0e5-44bb-967a-d481f22567e5 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-783780a5-e0e5-44bb-967a-d481f22567e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:52.302650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:52.303645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:52.304463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:52.304463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:52.304463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:52.304463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 263/522] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:52.304684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783780a5-e0e5-44bb-967a-d481f22567e5 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.316610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cdb2fc-ba10-4361-864d-d61cf1d37f87 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.353183 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553fcc-18d0-4658-860f-b98f47155f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.353790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553fcc-18d0-4658-860f-b98f47155f13 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.354095 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553fcc-18d0-4658-860f-b98f47155f13 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.354376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc553fcc-18d0-4658-860f-b98f47155f13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.409870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783780a5-e0e5-44bb-967a-d481f22567e5 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.415642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.422674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553fcc-18d0-4658-860f-b98f47155f13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.424190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc553fcc-18d0-4658-860f-b98f47155f13 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.427377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.444686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783aa43-6c5a-4f73-b296-3ffd37166782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.445290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783aa43-6c5a-4f73-b296-3ffd37166782 None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.445561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783aa43-6c5a-4f73-b296-3ffd37166782 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.445827 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6783aa43-6c5a-4f73-b296-3ffd37166782 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.446461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783aa43-6c5a-4f73-b296-3ffd37166782 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.447931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6783aa43-6c5a-4f73-b296-3ffd37166782 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.469245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 264/523] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:52:52 2022] POST /identity/v3/users => generated 247 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:52:52.470063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783aa43-6c5a-4f73-b296-3ffd37166782 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.540158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 260/524] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:52.541493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553fcc-18d0-4658-860f-b98f47155f13 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.616646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6783aa43-6c5a-4f73-b296-3ffd37166782 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.656750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.660943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07dd3d-106c-417c-9a89-8c98940f94d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.661553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07dd3d-106c-417c-9a89-8c98940f94d6 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.661834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07dd3d-106c-417c-9a89-8c98940f94d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.662108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f07dd3d-106c-417c-9a89-8c98940f94d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.662204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc553fcc-18d0-4658-860f-b98f47155f13 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.662992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07dd3d-106c-417c-9a89-8c98940f94d6 None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=c6ceb08f9eda4942a510bfaa0f0ef84e) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:52.663265 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07dd3d-106c-417c-9a89-8c98940f94d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.665513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f07dd3d-106c-417c-9a89-8c98940f94d6 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.671685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 265/525] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/role_assignments?user.id=c6ceb08f9eda4942a510bfaa0f0ef84e&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:52.672520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07dd3d-106c-417c-9a89-8c98940f94d6 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.709814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1f62-adda-4c44-a1b1-897d80df12d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.710445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1f62-adda-4c44-a1b1-897d80df12d3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.710724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1f62-adda-4c44-a1b1-897d80df12d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.711035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b1f62-adda-4c44-a1b1-897d80df12d3 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.711908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1f62-adda-4c44-a1b1-897d80df12d3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:52.712219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1f62-adda-4c44-a1b1-897d80df12d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.713803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3b1f62-adda-4c44-a1b1-897d80df12d3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.718529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.757868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 261/526] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:52.758738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1f62-adda-4c44-a1b1-897d80df12d3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.806445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f07dd3d-106c-417c-9a89-8c98940f94d6 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.845489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cb1c6-a4bc-4f82-aaf4-01f3c9d50cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.846106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cb1c6-a4bc-4f82-aaf4-01f3c9d50cef None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.846383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cb1c6-a4bc-4f82-aaf4-01f3c9d50cef None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.846653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6cb1c6-a4bc-4f82-aaf4-01f3c9d50cef None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.847328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cb1c6-a4bc-4f82-aaf4-01f3c9d50cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:52.847627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cb1c6-a4bc-4f82-aaf4-01f3c9d50cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.848999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6cb1c6-a4bc-4f82-aaf4-01f3c9d50cef None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.861637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 266/527] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:52.862560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cb1c6-a4bc-4f82-aaf4-01f3c9d50cef None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.876299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b1f62-adda-4c44-a1b1-897d80df12d3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.911319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9126766-a311-4392-b275-31a9eef559b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:52.911876 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9126766-a311-4392-b275-31a9eef559b8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:52.912143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9126766-a311-4392-b275-31a9eef559b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:52.912406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9126766-a311-4392-b275-31a9eef559b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:52.923060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9126766-a311-4392-b275-31a9eef559b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:52.924598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9126766-a311-4392-b275-31a9eef559b8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f9126766-a311-4392-b275-31a9eef559b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:52.940066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:52.941055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:52.941901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:52.941901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:52.941901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:52.941901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 262/528] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:52.942546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9126766-a311-4392-b275-31a9eef559b8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:52.951768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:52.975604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6cb1c6-a4bc-4f82-aaf4-01f3c9d50cef None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:52.979107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.020554 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66aba-4755-4587-af0a-180cd43b282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.022897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66aba-4755-4587-af0a-180cd43b282f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.022897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66aba-4755-4587-af0a-180cd43b282f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.023372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d66aba-4755-4587-af0a-180cd43b282f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.048860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9126766-a311-4392-b275-31a9eef559b8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.087154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d020-c78c-4f6a-b5df-bc003f5f56ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.087872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d020-c78c-4f6a-b5df-bc003f5f56ca None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.088213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d020-c78c-4f6a-b5df-bc003f5f56ca None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.088547 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a6d020-c78c-4f6a-b5df-bc003f5f56ca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.098435 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6d020-c78c-4f6a-b5df-bc003f5f56ca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.100023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a6d020-c78c-4f6a-b5df-bc003f5f56ca None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.112438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d66aba-4755-4587-af0a-180cd43b282f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e1a6d020-c78c-4f6a-b5df-bc003f5f56ca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:52:53.112920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:53.113702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:53.115168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:52:53.115168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:52:53.115168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:52:53.115168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:52:53.115168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:52:53.115168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:52:53.115168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:53.115168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:53.115168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 263/529] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:53.116225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d020-c78c-4f6a-b5df-bc003f5f56ca None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.118021 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d66aba-4755-4587-af0a-180cd43b282f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.200039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.239276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a6d020-c78c-4f6a-b5df-bc003f5f56ca None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.239491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 267/530] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:53.240280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66aba-4755-4587-af0a-180cd43b282f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.244587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.283990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9e709-1f30-401c-8b94-8663af8f6109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.284416 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9e709-1f30-401c-8b94-8663af8f6109 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.284779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9e709-1f30-401c-8b94-8663af8f6109 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.285116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c9e709-1f30-401c-8b94-8663af8f6109 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.285821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9e709-1f30-401c-8b94-8663af8f6109 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:53.286184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9e709-1f30-401c-8b94-8663af8f6109 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.287696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c9e709-1f30-401c-8b94-8663af8f6109 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.300196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 264/531] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:53.301091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9e709-1f30-401c-8b94-8663af8f6109 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.382863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d66aba-4755-4587-af0a-180cd43b282f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.408091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c9e709-1f30-401c-8b94-8663af8f6109 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.427549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494b2a-d440-4166-8487-f2f312aacb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.428566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494b2a-d440-4166-8487-f2f312aacb66 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.428948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494b2a-d440-4166-8487-f2f312aacb66 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.429282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22494b2a-d440-4166-8487-f2f312aacb66 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.430040 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22494b2a-d440-4166-8487-f2f312aacb66 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:53.430427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22494b2a-d440-4166-8487-f2f312aacb66 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.432345 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22494b2a-d440-4166-8487-f2f312aacb66 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.441537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.448136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 268/532] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:53.449489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494b2a-d440-4166-8487-f2f312aacb66 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.454972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da484a91-1457-4af6-891a-36269efcb0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.455820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da484a91-1457-4af6-891a-36269efcb0b8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.456273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da484a91-1457-4af6-891a-36269efcb0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.456735 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da484a91-1457-4af6-891a-36269efcb0b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.471369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da484a91-1457-4af6-891a-36269efcb0b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.473088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da484a91-1457-4af6-891a-36269efcb0b8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-da484a91-1457-4af6-891a-36269efcb0b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:53.493267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:53.494188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:53.495051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:53.495051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:53.495051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:53.501194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 265/533] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:53.501194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da484a91-1457-4af6-891a-36269efcb0b8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.519650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.573171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22494b2a-d440-4166-8487-f2f312aacb66 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.608501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da484a91-1457-4af6-891a-36269efcb0b8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.620576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7090bc0-88a4-4dfc-8da0-174673a77513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.621715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7090bc0-88a4-4dfc-8da0-174673a77513 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.622190 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7090bc0-88a4-4dfc-8da0-174673a77513 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.622702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7090bc0-88a4-4dfc-8da0-174673a77513 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.630198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7090bc0-88a4-4dfc-8da0-174673a77513 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.632258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7090bc0-88a4-4dfc-8da0-174673a77513 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.642750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc497d3a-2aa3-4751-b736-dc78cd38308a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.643389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc497d3a-2aa3-4751-b736-dc78cd38308a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.643662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc497d3a-2aa3-4751-b736-dc78cd38308a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.643929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc497d3a-2aa3-4751-b736-dc78cd38308a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.644803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc497d3a-2aa3-4751-b736-dc78cd38308a None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=7074acac73904bab8399f223bd662863) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:53.645108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc497d3a-2aa3-4751-b736-dc78cd38308a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.646870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc497d3a-2aa3-4751-b736-dc78cd38308a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-f7090bc0-88a4-4dfc-8da0-174673a77513 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:52:53.647216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:53.648072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:53.648903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:52:53.648903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:52:53.648903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:52:53.648903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:52:53.648903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:52:53.648903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:52:53.648903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:53.648903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:53.651439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 269/534] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:53.652512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7090bc0-88a4-4dfc-8da0-174673a77513 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.652982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 266/535] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/role_assignments?user.id=7074acac73904bab8399f223bd662863&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:53.657452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc497d3a-2aa3-4751-b736-dc78cd38308a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.749295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.820964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc497d3a-2aa3-4751-b736-dc78cd38308a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.857806 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089b2fc-4707-4c14-9f63-4522e78d605c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.858417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b2fc-4707-4c14-9f63-4522e78d605c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.858688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b2fc-4707-4c14-9f63-4522e78d605c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.858998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f089b2fc-4707-4c14-9f63-4522e78d605c None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.859845 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089b2fc-4707-4c14-9f63-4522e78d605c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:53.860148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089b2fc-4707-4c14-9f63-4522e78d605c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.861596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f089b2fc-4707-4c14-9f63-4522e78d605c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.882825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 267/536] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:53.890671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089b2fc-4707-4c14-9f63-4522e78d605c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:53.891142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7090bc0-88a4-4dfc-8da0-174673a77513 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:53.913474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:53.933102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586816-006b-4cee-8cd7-e78095d71e2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:53.934215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586816-006b-4cee-8cd7-e78095d71e2e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:53.934683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586816-006b-4cee-8cd7-e78095d71e2e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:53.935169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53586816-006b-4cee-8cd7-e78095d71e2e None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:53.935999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53586816-006b-4cee-8cd7-e78095d71e2e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:53.936486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53586816-006b-4cee-8cd7-e78095d71e2e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:53.938085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53586816-006b-4cee-8cd7-e78095d71e2e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:53.952148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 270/537] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:53.957462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586816-006b-4cee-8cd7-e78095d71e2e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:54.071948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53586816-006b-4cee-8cd7-e78095d71e2e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:54.104775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f089b2fc-4707-4c14-9f63-4522e78d605c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:54.107789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:54.111220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70847b7b-9380-4652-a5d4-fb49a8c16d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:54.112168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70847b7b-9380-4652-a5d4-fb49a8c16d74 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:54.112633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70847b7b-9380-4652-a5d4-fb49a8c16d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.113510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70847b7b-9380-4652-a5d4-fb49a8c16d74 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.122072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70847b7b-9380-4652-a5d4-fb49a8c16d74 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:54.123847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70847b7b-9380-4652-a5d4-fb49a8c16d74 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-70847b7b-9380-4652-a5d4-fb49a8c16d74 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:52:54.137389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:54.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:54.139212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:52:54.139212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:52:54.139212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:52:54.139212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:52:54.139212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:52:54.139212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:52:54.139212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:54.139212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:54.141589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 271/538] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:54.147656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70847b7b-9380-4652-a5d4-fb49a8c16d74 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:54.193465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a195b-f506-4967-a3c7-285a4cd8b5cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:54.194090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a195b-f506-4967-a3c7-285a4cd8b5cc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:54.194369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a195b-f506-4967-a3c7-285a4cd8b5cc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.194629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:54.194738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a195b-f506-4967-a3c7-285a4cd8b5cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.195652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a195b-f506-4967-a3c7-285a4cd8b5cc None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=7b93049bc8aa47648d101a3f937ca8db) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:54.195769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a195b-f506-4967-a3c7-285a4cd8b5cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:54.197311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1a195b-f506-4967-a3c7-285a4cd8b5cc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:54.211234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 268/539] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:53 2022] GET /identity/v3/role_assignments?user.id=7b93049bc8aa47648d101a3f937ca8db&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 259 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:54.261812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70847b7b-9380-4652-a5d4-fb49a8c16d74 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:54.300213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5f675-c2fe-4b32-8139-da3ede6c826e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:54.301229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5f675-c2fe-4b32-8139-da3ede6c826e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:54.301694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5f675-c2fe-4b32-8139-da3ede6c826e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.302151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5f675-c2fe-4b32-8139-da3ede6c826e None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.303091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5f675-c2fe-4b32-8139-da3ede6c826e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:54.303643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5f675-c2fe-4b32-8139-da3ede6c826e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:54.305302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac5f675-c2fe-4b32-8139-da3ede6c826e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:54.319057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 272/540] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:52:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:54.326916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a195b-f506-4967-a3c7-285a4cd8b5cc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:54.478057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a195b-f506-4967-a3c7-285a4cd8b5cc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:54.514696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8178cbc6-7500-49c2-aebf-9f0dca1910b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:54.515328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178cbc6-7500-49c2-aebf-9f0dca1910b8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:54.515608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178cbc6-7500-49c2-aebf-9f0dca1910b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.515880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8178cbc6-7500-49c2-aebf-9f0dca1910b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.516614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178cbc6-7500-49c2-aebf-9f0dca1910b8 None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=309ebac21dd944029b1de80ba54dd794) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:54.516922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178cbc6-7500-49c2-aebf-9f0dca1910b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:54.518377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8178cbc6-7500-49c2-aebf-9f0dca1910b8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:54.525413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 269/541] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:54 2022] GET /identity/v3/role_assignments?user.id=309ebac21dd944029b1de80ba54dd794&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:54.658938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032da14-1fa7-400b-a5dd-844558299e6e None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:54.658938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032da14-1fa7-400b-a5dd-844558299e6e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.658938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1032da14-1fa7-400b-a5dd-844558299e6e None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.659803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 273/542] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:54.672633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22c63-596a-4d50-b823-d9d339d42aec None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:54.673202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22c63-596a-4d50-b823-d9d339d42aec None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.673671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b22c63-596a-4d50-b823-d9d339d42aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.700144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-05b22c63-596a-4d50-b823-d9d339d42aec None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:54.701374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-05b22c63-596a-4d50-b823-d9d339d42aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:54.740145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:54.798734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 270/543] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:54.836090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ac7f-8425-41b2-b2b8-e8e5b9f1f054 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:54.836369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ac7f-8425-41b2-b2b8-e8e5b9f1f054 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.836641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7012ac7f-8425-41b2-b2b8-e8e5b9f1f054 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.838120 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 274/544] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:54.844171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb8331-a4f5-431a-a1e3-b155a837b314 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:54.844464 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb8331-a4f5-431a-a1e3-b155a837b314 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:54.844745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eb8331-a4f5-431a-a1e3-b155a837b314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:54.863347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-54eb8331-a4f5-431a-a1e3-b155a837b314 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:54.864553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-54eb8331-a4f5-431a-a1e3-b155a837b314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:54.946125 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 271/545] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:55.228283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012ac7f-8425-41b2-b2b8-e8e5b9f1f054 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:55.345773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:55.350530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7012ac7f-8425-41b2-b2b8-e8e5b9f1f054 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:55.380258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb8331-a4f5-431a-a1e3-b155a837b314 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:55.395129 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a88ec-8776-4baf-a9b6-dde9d9eed849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:55.396521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a88ec-8776-4baf-a9b6-dde9d9eed849 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:55.397001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a88ec-8776-4baf-a9b6-dde9d9eed849 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:55.397446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783a88ec-8776-4baf-a9b6-dde9d9eed849 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:55.415602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783a88ec-8776-4baf-a9b6-dde9d9eed849 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-783a88ec-8776-4baf-a9b6-dde9d9eed849 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:55.421151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:55.422057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:55.422914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:55.425513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 275/546] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:55.430729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a88ec-8776-4baf-a9b6-dde9d9eed849 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:55.484276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:55.505907 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eb8331-a4f5-431a-a1e3-b155a837b314 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:55.550199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777a55c-0aa0-4fb7-8bd4-3f652a976b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:55.550858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a55c-0aa0-4fb7-8bd4-3f652a976b37 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:55.551135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a55c-0aa0-4fb7-8bd4-3f652a976b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:55.551399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a777a55c-0aa0-4fb7-8bd4-3f652a976b37 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:55.569874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a777a55c-0aa0-4fb7-8bd4-3f652a976b37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a777a55c-0aa0-4fb7-8bd4-3f652a976b37 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:55.574688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:55.575636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:55.576434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:55.588505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 272/547] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:55.589559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777a55c-0aa0-4fb7-8bd4-3f652a976b37 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:55.653638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783a88ec-8776-4baf-a9b6-dde9d9eed849 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:55.719840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e975ec-5797-40b2-bf5a-c990a454c180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:55.720810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e975ec-5797-40b2-bf5a-c990a454c180 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:55.721287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e975ec-5797-40b2-bf5a-c990a454c180 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:55.721725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e975ec-5797-40b2-bf5a-c990a454c180 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:55.722541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e975ec-5797-40b2-bf5a-c990a454c180 None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:55.723013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e975ec-5797-40b2-bf5a-c990a454c180 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:55.724553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e975ec-5797-40b2-bf5a-c990a454c180 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:55.730015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a777a55c-0aa0-4fb7-8bd4-3f652a976b37 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:55.745496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 276/548] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:52:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:55.752044 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e975ec-5797-40b2-bf5a-c990a454c180 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:55.777723 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3206e-a4ae-4b8a-b7b5-f3af525f1b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:55.779564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3206e-a4ae-4b8a-b7b5-f3af525f1b6c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:55.779850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3206e-a4ae-4b8a-b7b5-f3af525f1b6c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:55.780123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3206e-a4ae-4b8a-b7b5-f3af525f1b6c None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:55.781833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3206e-a4ae-4b8a-b7b5-f3af525f1b6c None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:55.782141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3206e-a4ae-4b8a-b7b5-f3af525f1b6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:55.786996 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3206e-a4ae-4b8a-b7b5-f3af525f1b6c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:55.798071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:55.805014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 273/549] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:52:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:55.811127 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3206e-a4ae-4b8a-b7b5-f3af525f1b6c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:55.842219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:55.949760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e975ec-5797-40b2-bf5a-c990a454c180 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:55.981404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3206e-a4ae-4b8a-b7b5-f3af525f1b6c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.018644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adfd53-44d2-4378-9bbd-bbc28cfa2175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.019343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfd53-44d2-4378-9bbd-bbc28cfa2175 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.019621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfd53-44d2-4378-9bbd-bbc28cfa2175 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.019995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8adfd53-44d2-4378-9bbd-bbc28cfa2175 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.020362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8246254e-9896-4154-9354-639587fb4e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.021334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246254e-9896-4154-9354-639587fb4e5a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.021614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246254e-9896-4154-9354-639587fb4e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.021886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8246254e-9896-4154-9354-639587fb4e5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.032499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adfd53-44d2-4378-9bbd-bbc28cfa2175 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.034524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8adfd53-44d2-4378-9bbd-bbc28cfa2175 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.035718 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246254e-9896-4154-9354-639587fb4e5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.037417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8246254e-9896-4154-9354-639587fb4e5a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c8adfd53-44d2-4378-9bbd-bbc28cfa2175 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:56.051998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:56.053191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:56.054064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:56.054064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:56.054064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-8246254e-9896-4154-9354-639587fb4e5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:56.054229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:56.055079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:56.055929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:56.055929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:56.055929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:56.055929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 277/550] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:56.055929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11181c42-692c-4062-9c3d-82255a46d2aa None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.056203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11181c42-692c-4062-9c3d-82255a46d2aa None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.056344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11181c42-692c-4062-9c3d-82255a46d2aa None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.058184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 274/551] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:56.062831 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 278/552] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:56.064475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663ae6-ccae-4678-a076-80cecacb244c None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.064756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663ae6-ccae-4678-a076-80cecacb244c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.065027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66663ae6-ccae-4678-a076-80cecacb244c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.067720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adfd53-44d2-4378-9bbd-bbc28cfa2175 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.083414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-66663ae6-ccae-4678-a076-80cecacb244c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:56.084611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-66663ae6-ccae-4678-a076-80cecacb244c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:56.134092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.155029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 279/553] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:56.155956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66663ae6-ccae-4678-a076-80cecacb244c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.158366 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.177687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8adfd53-44d2-4378-9bbd-bbc28cfa2175 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.224074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c512b8-a2b1-48bc-a521-2a064a8084a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.224699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c512b8-a2b1-48bc-a521-2a064a8084a2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.224981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c512b8-a2b1-48bc-a521-2a064a8084a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.225254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c512b8-a2b1-48bc-a521-2a064a8084a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.225904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c512b8-a2b1-48bc-a521-2a064a8084a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:56.226208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c512b8-a2b1-48bc-a521-2a064a8084a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.227637 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c512b8-a2b1-48bc-a521-2a064a8084a2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.251584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 275/554] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:52:56.257951 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c512b8-a2b1-48bc-a521-2a064a8084a2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.297237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66663ae6-ccae-4678-a076-80cecacb244c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.336712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb937-7988-442c-95d8-eb9c5975424e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.337911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb937-7988-442c-95d8-eb9c5975424e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.338379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb937-7988-442c-95d8-eb9c5975424e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.338896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cb937-7988-442c-95d8-eb9c5975424e None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.339830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cb937-7988-442c-95d8-eb9c5975424e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:56.341328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cb937-7988-442c-95d8-eb9c5975424e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.342934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cb937-7988-442c-95d8-eb9c5975424e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.356145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 280/555] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:56.362497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb937-7988-442c-95d8-eb9c5975424e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.461081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.470201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c512b8-a2b1-48bc-a521-2a064a8084a2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.498423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.509069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cb937-7988-442c-95d8-eb9c5975424e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.511035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270ea01-3438-4a00-80a3-3cb2a61e45af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.512094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ea01-3438-4a00-80a3-3cb2a61e45af None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.512662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ea01-3438-4a00-80a3-3cb2a61e45af None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.513134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0270ea01-3438-4a00-80a3-3cb2a61e45af None admin] PATH_INFO: `/v3/users/nova` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.521722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270ea01-3438-4a00-80a3-3cb2a61e45af None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.523564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0270ea01-3438-4a00-80a3-3cb2a61e45af None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0270ea01-3438-4a00-80a3-3cb2a61e45af None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:52:56.536916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:56.537869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:56.538822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:56.538822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:56.538822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:52:56.538822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:52:56.538822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:52:56.538822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:52:56.538822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:52:56.538822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:52:56.538822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:52:56.538822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:56.540965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 276/556] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:56.541938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270ea01-3438-4a00-80a3-3cb2a61e45af None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.545182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56458f0d-9777-46a7-a6a7-2f64c55f75ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.545915 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56458f0d-9777-46a7-a6a7-2f64c55f75ee None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.546960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56458f0d-9777-46a7-a6a7-2f64c55f75ee None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.546960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56458f0d-9777-46a7-a6a7-2f64c55f75ee None admin] PATH_INFO: `/v3/users/swift` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.554661 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56458f0d-9777-46a7-a6a7-2f64c55f75ee None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.556112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56458f0d-9777-46a7-a6a7-2f64c55f75ee None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-56458f0d-9777-46a7-a6a7-2f64c55f75ee None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:52:56.567516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:56.568539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 281/557] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:52:56.569942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56458f0d-9777-46a7-a6a7-2f64c55f75ee None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.653736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0270ea01-3438-4a00-80a3-3cb2a61e45af None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.679540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56458f0d-9777-46a7-a6a7-2f64c55f75ee None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.697052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05db17-fa6e-474e-a33e-83e00d0bd5a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.697843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05db17-fa6e-474e-a33e-83e00d0bd5a9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.698129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05db17-fa6e-474e-a33e-83e00d0bd5a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.698583 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e05db17-fa6e-474e-a33e-83e00d0bd5a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.709490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e05db17-fa6e-474e-a33e-83e00d0bd5a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4e05db17-fa6e-474e-a33e-83e00d0bd5a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:56.714961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:56.716143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:56.717081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 277/558] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:56.717864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05db17-fa6e-474e-a33e-83e00d0bd5a9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.720643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.726706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecf26b-af5e-4470-8db6-847109f53076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.727622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecf26b-af5e-4470-8db6-847109f53076 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.728510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecf26b-af5e-4470-8db6-847109f53076 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.728976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fecf26b-af5e-4470-8db6-847109f53076 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.730041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecf26b-af5e-4470-8db6-847109f53076 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:56.730922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecf26b-af5e-4470-8db6-847109f53076 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.733153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fecf26b-af5e-4470-8db6-847109f53076 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.754499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 282/559] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:56.758999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecf26b-af5e-4470-8db6-847109f53076 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.772737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.828225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e05db17-fa6e-474e-a33e-83e00d0bd5a9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.861550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b166da52-14ea-4c77-b54d-15eb5bcf7a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.862142 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166da52-14ea-4c77-b54d-15eb5bcf7a9c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.862411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166da52-14ea-4c77-b54d-15eb5bcf7a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.862677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166da52-14ea-4c77-b54d-15eb5bcf7a9c None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.863424 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166da52-14ea-4c77-b54d-15eb5bcf7a9c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:56.863721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166da52-14ea-4c77-b54d-15eb5bcf7a9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.863899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fecf26b-af5e-4470-8db6-847109f53076 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:56.865141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b166da52-14ea-4c77-b54d-15eb5bcf7a9c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.882331 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 278/560] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:56.883354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb156ef-fe5d-491a-a04a-9c572dad033b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.883630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb156ef-fe5d-491a-a04a-9c572dad033b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.883899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb156ef-fe5d-491a-a04a-9c572dad033b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.885089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 279/561] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:56.885768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb156ef-fe5d-491a-a04a-9c572dad033b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.905218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8193a654-f69f-440b-9602-6f3e3c83dd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:56.906032 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193a654-f69f-440b-9602-6f3e3c83dd55 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.906404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193a654-f69f-440b-9602-6f3e3c83dd55 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.906782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8193a654-f69f-440b-9602-6f3e3c83dd55 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.907553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193a654-f69f-440b-9602-6f3e3c83dd55 None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:56.907955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193a654-f69f-440b-9602-6f3e3c83dd55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:56.909441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8193a654-f69f-440b-9602-6f3e3c83dd55 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:56.917548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 283/562] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:56.918933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57824-5b62-4ef6-a6b8-99146a46b642 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:56.919214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57824-5b62-4ef6-a6b8-99146a46b642 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:56.919485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d57824-5b62-4ef6-a6b8-99146a46b642 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:56.920811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 284/563] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:52:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:52:56.921366 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57824-5b62-4ef6-a6b8-99146a46b642 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:56.971038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:56.999667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb156ef-fe5d-491a-a04a-9c572dad033b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.001223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.028412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d57824-5b62-4ef6-a6b8-99146a46b642 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.037710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083748b1-6a83-41ba-8e4c-6e41af6639cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.038339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083748b1-6a83-41ba-8e4c-6e41af6639cb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.038616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083748b1-6a83-41ba-8e4c-6e41af6639cb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.038934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083748b1-6a83-41ba-8e4c-6e41af6639cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.049516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083748b1-6a83-41ba-8e4c-6e41af6639cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.051017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083748b1-6a83-41ba-8e4c-6e41af6639cb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.062046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd268a93-1272-4ec7-835c-5ac779e12a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.062644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268a93-1272-4ec7-835c-5ac779e12a5a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.062948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268a93-1272-4ec7-835c-5ac779e12a5a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.063218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd268a93-1272-4ec7-835c-5ac779e12a5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-083748b1-6a83-41ba-8e4c-6e41af6639cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:57.066232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:57.067368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:57.068389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:57.068389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:57.068389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:57.068389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 280/564] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:57.069269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a69a-7237-4bb7-95da-2cfa52c48707 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.069548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a69a-7237-4bb7-95da-2cfa52c48707 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.069820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0a69a-7237-4bb7-95da-2cfa52c48707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.089589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-18b0a69a-7237-4bb7-95da-2cfa52c48707 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:57.091151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-18b0a69a-7237-4bb7-95da-2cfa52c48707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:57.131529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd268a93-1272-4ec7-835c-5ac779e12a5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.133002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd268a93-1272-4ec7-835c-5ac779e12a5a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.162593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 281/565] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:57.163477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a69a-7237-4bb7-95da-2cfa52c48707 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.188419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.253302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 285/566] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:52:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:52:57.254715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a21c-3df5-4eb2-850d-db568c35f51a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.255125 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a21c-3df5-4eb2-850d-db568c35f51a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.255477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4940a21c-3df5-4eb2-850d-db568c35f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.265138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.274377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-4940a21c-3df5-4eb2-850d-db568c35f51a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:52:57.275614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4940a21c-3df5-4eb2-850d-db568c35f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:52:57.285125 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0a69a-7237-4bb7-95da-2cfa52c48707 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.325679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b87c3-fd77-4b08-ac28-76dbb4138350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.326304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b87c3-fd77-4b08-ac28-76dbb4138350 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.326583 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b87c3-fd77-4b08-ac28-76dbb4138350 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.326881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43b87c3-fd77-4b08-ac28-76dbb4138350 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.337074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b87c3-fd77-4b08-ac28-76dbb4138350 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.338541 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43b87c3-fd77-4b08-ac28-76dbb4138350 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.358872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 286/567] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:52:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:52:57.358872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940a21c-3df5-4eb2-850d-db568c35f51a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b43b87c3-fd77-4b08-ac28-76dbb4138350 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:57.359439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:57.360505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:57.361582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:57.361582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:57.361582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:57.361582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 282/568] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:57.361582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b87c3-fd77-4b08-ac28-76dbb4138350 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.445902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.467153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43b87c3-fd77-4b08-ac28-76dbb4138350 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.481651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4940a21c-3df5-4eb2-850d-db568c35f51a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.502554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa8653-c00a-45a4-8ea6-061f1a12b551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.503401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa8653-c00a-45a4-8ea6-061f1a12b551 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.503678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa8653-c00a-45a4-8ea6-061f1a12b551 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.503943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aa8653-c00a-45a4-8ea6-061f1a12b551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.506808 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.515943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa8653-c00a-45a4-8ea6-061f1a12b551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.517426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aa8653-c00a-45a4-8ea6-061f1a12b551 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.518282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8dab7-90e3-4321-9289-6346e751dcc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.518925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8dab7-90e3-4321-9289-6346e751dcc5 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.519306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8dab7-90e3-4321-9289-6346e751dcc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.519575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c8dab7-90e3-4321-9289-6346e751dcc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.520322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8dab7-90e3-4321-9289-6346e751dcc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:57.520593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8dab7-90e3-4321-9289-6346e751dcc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.522273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c8dab7-90e3-4321-9289-6346e751dcc5 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-c7aa8653-c00a-45a4-8ea6-061f1a12b551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:57.533426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:57.539234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:57.540131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:57.540131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:57.540131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:57.540299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 287/569] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:57.540299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8dab7-90e3-4321-9289-6346e751dcc5 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.540425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 283/570] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:57.540425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa8653-c00a-45a4-8ea6-061f1a12b551 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.643033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aa8653-c00a-45a4-8ea6-061f1a12b551 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.643216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c8dab7-90e3-4321-9289-6346e751dcc5 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.671725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.676134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a624-1715-47f3-ac95-d341dc1f4b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.676757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a624-1715-47f3-ac95-d341dc1f4b92 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.676910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f65fe2-c652-478c-a7c6-c8a546dc7cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.677018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a624-1715-47f3-ac95-d341dc1f4b92 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.677281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb8a624-1715-47f3-ac95-d341dc1f4b92 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.677513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65fe2-c652-478c-a7c6-c8a546dc7cc0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.677791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65fe2-c652-478c-a7c6-c8a546dc7cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.678064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f65fe2-c652-478c-a7c6-c8a546dc7cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.678702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f65fe2-c652-478c-a7c6-c8a546dc7cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:57.679049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f65fe2-c652-478c-a7c6-c8a546dc7cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.680425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f65fe2-c652-478c-a7c6-c8a546dc7cc0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.687723 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb8a624-1715-47f3-ac95-d341dc1f4b92 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:57.692257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 288/571] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8eb8a624-1715-47f3-ac95-d341dc1f4b92 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:57.692733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:57.693979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:57.695269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:57.695891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f65fe2-c652-478c-a7c6-c8a546dc7cc0 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.695962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 284/572] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:57.695962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a624-1715-47f3-ac95-d341dc1f4b92 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.746402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.802618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f65fe2-c652-478c-a7c6-c8a546dc7cc0 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.809703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb8a624-1715-47f3-ac95-d341dc1f4b92 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.839018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998c7ee-73e2-495d-9e79-8afb02e6f7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.839860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998c7ee-73e2-495d-9e79-8afb02e6f7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.840254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998c7ee-73e2-495d-9e79-8afb02e6f7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.840527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0998c7ee-73e2-495d-9e79-8afb02e6f7c1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.841938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0178d-670a-425f-826c-b18e890403db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:57.842540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0178d-670a-425f-826c-b18e890403db None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:57.843000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0178d-670a-425f-826c-b18e890403db None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:57.843271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c0178d-670a-425f-826c-b18e890403db None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:57.844245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0178d-670a-425f-826c-b18e890403db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:57.844546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0178d-670a-425f-826c-b18e890403db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.845956 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c0178d-670a-425f-826c-b18e890403db None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.847849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998c7ee-73e2-495d-9e79-8afb02e6f7c1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:57.849281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0998c7ee-73e2-495d-9e79-8afb02e6f7c1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:57.858157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 285/573] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:57.858906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0178d-670a-425f-826c-b18e890403db None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-0998c7ee-73e2-495d-9e79-8afb02e6f7c1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:52:57.861056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:57.861887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:57.862804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:52:57.862804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:52:57.862804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:52:57.862804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:52:57.862804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:52:57.862804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:52:57.862804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:57.862804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:57.862804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 289/574] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:57.863305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998c7ee-73e2-495d-9e79-8afb02e6f7c1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:57.916666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:57.964540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0998c7ee-73e2-495d-9e79-8afb02e6f7c1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.964727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c0178d-670a-425f-826c-b18e890403db None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:57.975170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.003107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf8973-af53-4d58-9b69-2b54a47f93c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.003794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf8973-af53-4d58-9b69-2b54a47f93c0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.004020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf8973-af53-4d58-9b69-2b54a47f93c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.004280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf8973-af53-4d58-9b69-2b54a47f93c0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.006819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57d5c8-a52d-4a16-9547-15652c2148f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.007451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57d5c8-a52d-4a16-9547-15652c2148f0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.007726 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57d5c8-a52d-4a16-9547-15652c2148f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.008001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a57d5c8-a52d-4a16-9547-15652c2148f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.012494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf8973-af53-4d58-9b69-2b54a47f93c0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.013970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccf8973-af53-4d58-9b69-2b54a47f93c0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.018607 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a57d5c8-a52d-4a16-9547-15652c2148f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6a57d5c8-a52d-4a16-9547-15652c2148f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:52:58.023632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:58.024593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:58.025431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 286/575] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-8ccf8973-af53-4d58-9b69-2b54a47f93c0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:52:58.026154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:58.028173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:58.029341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:58.029341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:58.029341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:52:58.029341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:52:58.029341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:52:58.029341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:52:58.029341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:52:58.029341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:52:58.029341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:52:58.029341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:58.030270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57d5c8-a52d-4a16-9547-15652c2148f0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.030344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 290/576] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:57 2022] GET /identity/v3/users/glance => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:58.030344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf8973-af53-4d58-9b69-2b54a47f93c0 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.132241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a57d5c8-a52d-4a16-9547-15652c2148f0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.132487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf8973-af53-4d58-9b69-2b54a47f93c0 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.145576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.167907 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61edc11-05f7-422e-883b-5dd617395ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.168133 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049781e-89c8-4292-9c3a-553bd7dc7d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.168468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61edc11-05f7-422e-883b-5dd617395ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.168723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049781e-89c8-4292-9c3a-553bd7dc7d10 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.168824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61edc11-05f7-422e-883b-5dd617395ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.168995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61edc11-05f7-422e-883b-5dd617395ac6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.169081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049781e-89c8-4292-9c3a-553bd7dc7d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.169262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f049781e-89c8-4292-9c3a-553bd7dc7d10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.169655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61edc11-05f7-422e-883b-5dd617395ac6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:58.169951 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61edc11-05f7-422e-883b-5dd617395ac6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.171364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61edc11-05f7-422e-883b-5dd617395ac6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.176019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049781e-89c8-4292-9c3a-553bd7dc7d10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.177485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f049781e-89c8-4292-9c3a-553bd7dc7d10 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.179441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 287/577] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:58.180223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61edc11-05f7-422e-883b-5dd617395ac6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-f049781e-89c8-4292-9c3a-553bd7dc7d10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:52:58.189407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:58.190307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:58.191224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:52:58.191224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:52:58.191224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:52:58.191224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:52:58.191224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:52:58.191224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:52:58.191224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:58.191224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:58.191224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 291/578] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:58.191707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049781e-89c8-4292-9c3a-553bd7dc7d10 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.213831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.287816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61edc11-05f7-422e-883b-5dd617395ac6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.291677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f049781e-89c8-4292-9c3a-553bd7dc7d10 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.322084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eccedb-e099-497a-8358-241c54872e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.322694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eccedb-e099-497a-8358-241c54872e6b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.322998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eccedb-e099-497a-8358-241c54872e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.323271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eccedb-e099-497a-8358-241c54872e6b None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.324474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eccedb-e099-497a-8358-241c54872e6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:58.324991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eccedb-e099-497a-8358-241c54872e6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.326168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e29d1e-54ef-4102-8c8b-81ab7ada6178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.326800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e29d1e-54ef-4102-8c8b-81ab7ada6178 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.327033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eccedb-e099-497a-8358-241c54872e6b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.327422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e29d1e-54ef-4102-8c8b-81ab7ada6178 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.327422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e29d1e-54ef-4102-8c8b-81ab7ada6178 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.328024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e29d1e-54ef-4102-8c8b-81ab7ada6178 None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:58.328306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e29d1e-54ef-4102-8c8b-81ab7ada6178 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.329652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e29d1e-54ef-4102-8c8b-81ab7ada6178 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.338071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 292/579] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:58.338898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e29d1e-54ef-4102-8c8b-81ab7ada6178 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.339310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 288/580] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:58.340004 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eccedb-e099-497a-8358-241c54872e6b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.381245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.440616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.450830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eccedb-e099-497a-8358-241c54872e6b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.451261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e29d1e-54ef-4102-8c8b-81ab7ada6178 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.483653 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b89f0-eaa0-4737-a3bd-fce43a731e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.484278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b89f0-eaa0-4737-a3bd-fce43a731e1c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.484553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b89f0-eaa0-4737-a3bd-fce43a731e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.484664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37430d0-5c2b-4296-9141-05609e7ef7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.484823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b89f0-eaa0-4737-a3bd-fce43a731e1c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.485206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37430d0-5c2b-4296-9141-05609e7ef7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.485483 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37430d0-5c2b-4296-9141-05609e7ef7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.485754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37430d0-5c2b-4296-9141-05609e7ef7d2 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.486479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37430d0-5c2b-4296-9141-05609e7ef7d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:58.486811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37430d0-5c2b-4296-9141-05609e7ef7d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.488305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37430d0-5c2b-4296-9141-05609e7ef7d2 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.494836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b89f0-eaa0-4737-a3bd-fce43a731e1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.496567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b89f0-eaa0-4737-a3bd-fce43a731e1c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.506469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 293/581] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:58.507317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37430d0-5c2b-4296-9141-05609e7ef7d2 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8e6b89f0-eaa0-4737-a3bd-fce43a731e1c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:58.512312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:58.513713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:58.514802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:58.514802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:58.514802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:58.514802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 289/582] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:58.514802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b89f0-eaa0-4737-a3bd-fce43a731e1c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.603672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.613767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37430d0-5c2b-4296-9141-05609e7ef7d2 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.615177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b89f0-eaa0-4737-a3bd-fce43a731e1c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.648458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7634d8-e53b-4fbb-b9f7-ba071608d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.648829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324568f4-8820-4bf1-8abe-8939ebe5d250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.649065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7634d8-e53b-4fbb-b9f7-ba071608d80b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.649340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7634d8-e53b-4fbb-b9f7-ba071608d80b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.649477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324568f4-8820-4bf1-8abe-8939ebe5d250 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.649611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7634d8-e53b-4fbb-b9f7-ba071608d80b None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.649756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324568f4-8820-4bf1-8abe-8939ebe5d250 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.650041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324568f4-8820-4bf1-8abe-8939ebe5d250 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/c6ceb08f9eda4942a510bfaa0f0ef84e/roles/9b6f095785d54dbe9e3c0b35fff633d2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.650298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7634d8-e53b-4fbb-b9f7-ba071608d80b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:58.650593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7634d8-e53b-4fbb-b9f7-ba071608d80b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.652277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7634d8-e53b-4fbb-b9f7-ba071608d80b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.662087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.663417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 294/583] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:58.664221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7634d8-e53b-4fbb-b9f7-ba071608d80b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.665590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324568f4-8820-4bf1-8abe-8939ebe5d250 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=c6ceb08f9eda4942a510bfaa0f0ef84e, role_id=9b6f095785d54dbe9e3c0b35fff633d2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.667070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324568f4-8820-4bf1-8abe-8939ebe5d250 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.681177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 290/584] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:52:58 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/c6ceb08f9eda4942a510bfaa0f0ef84e/roles/9b6f095785d54dbe9e3c0b35fff633d2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:52:58.681988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324568f4-8820-4bf1-8abe-8939ebe5d250 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.805577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324568f4-8820-4bf1-8abe-8939ebe5d250 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.806374 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7634d8-e53b-4fbb-b9f7-ba071608d80b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:58.848697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61297e-5453-4f47-a403-acf131fac6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.849594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61297e-5453-4f47-a403-acf131fac6ff None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.849880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61297e-5453-4f47-a403-acf131fac6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.850155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d61297e-5453-4f47-a403-acf131fac6ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.853033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f37ac-2620-4678-9c21-76d9e48de45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:58.853745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f37ac-2620-4678-9c21-76d9e48de45f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:58.854116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f37ac-2620-4678-9c21-76d9e48de45f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:58.854499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33f37ac-2620-4678-9c21-76d9e48de45f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:58.863945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61297e-5453-4f47-a403-acf131fac6ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.866455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d61297e-5453-4f47-a403-acf131fac6ff None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.872278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f37ac-2620-4678-9c21-76d9e48de45f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:58.874930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33f37ac-2620-4678-9c21-76d9e48de45f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7d61297e-5453-4f47-a403-acf131fac6ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:58.889634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:58.890698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:58.895375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:58.895375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:58.895375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:58.895375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 291/585] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:58.895375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61297e-5453-4f47-a403-acf131fac6ff None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-b33f37ac-2620-4678-9c21-76d9e48de45f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:52:58.900678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:58.901825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:52:58.902886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:52:58.902886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:52:58.902886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:58.903943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 295/586] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:58.905314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f37ac-2620-4678-9c21-76d9e48de45f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:58.912120 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:58.963620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:59.016147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33f37ac-2620-4678-9c21-76d9e48de45f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.024841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d61297e-5453-4f47-a403-acf131fac6ff None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.053584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b4f14-d65a-4a2d-bc4e-a41fbb2892d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.054300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4f14-d65a-4a2d-bc4e-a41fbb2892d1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.054640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4f14-d65a-4a2d-bc4e-a41fbb2892d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.055033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b4f14-d65a-4a2d-bc4e-a41fbb2892d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.055774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b4f14-d65a-4a2d-bc4e-a41fbb2892d1 None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=410e8bceb7664e1d9968f85f41cc0828) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:59.056077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b4f14-d65a-4a2d-bc4e-a41fbb2892d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.057512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b4f14-d65a-4a2d-bc4e-a41fbb2892d1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.061107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b36f6-df8b-4c8d-916f-fc678844b5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.061960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b36f6-df8b-4c8d-916f-fc678844b5d3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.062406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b36f6-df8b-4c8d-916f-fc678844b5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.062882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b36f6-df8b-4c8d-916f-fc678844b5d3 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.063695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b36f6-df8b-4c8d-916f-fc678844b5d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:59.064199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b36f6-df8b-4c8d-916f-fc678844b5d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.065712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b36f6-df8b-4c8d-916f-fc678844b5d3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.069397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 296/587] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/role_assignments?user.id=410e8bceb7664e1d9968f85f41cc0828&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:59.070466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b4f14-d65a-4a2d-bc4e-a41fbb2892d1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.092294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 292/588] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:59.092294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b36f6-df8b-4c8d-916f-fc678844b5d3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.210926 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:59.261105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b36f6-df8b-4c8d-916f-fc678844b5d3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.264990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:59.269315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b4f14-d65a-4a2d-bc4e-a41fbb2892d1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.304659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1a646-e573-4be5-97ac-3c9a0e318a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.306319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a646-e573-4be5-97ac-3c9a0e318a6b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.306663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a646-e573-4be5-97ac-3c9a0e318a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.307098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c1a646-e573-4be5-97ac-3c9a0e318a6b None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.308024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1a646-e573-4be5-97ac-3c9a0e318a6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:59.308640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1a646-e573-4be5-97ac-3c9a0e318a6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.310161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c1a646-e573-4be5-97ac-3c9a0e318a6b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.330945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 293/589] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:59.330945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1a646-e573-4be5-97ac-3c9a0e318a6b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.335650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e75818-0348-4038-bc00-a0e5590e3f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.336930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e75818-0348-4038-bc00-a0e5590e3f08 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.337672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e75818-0348-4038-bc00-a0e5590e3f08 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.338362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e75818-0348-4038-bc00-a0e5590e3f08 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.340464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e75818-0348-4038-bc00-a0e5590e3f08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:59.341230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e75818-0348-4038-bc00-a0e5590e3f08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.344231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e75818-0348-4038-bc00-a0e5590e3f08 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.365928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 297/590] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:59.367804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e75818-0348-4038-bc00-a0e5590e3f08 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.464014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c1a646-e573-4be5-97ac-3c9a0e318a6b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.486669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e75818-0348-4038-bc00-a0e5590e3f08 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.499973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9524bb-cb9e-4589-8a76-62396d194427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.500624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9524bb-cb9e-4589-8a76-62396d194427 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.500935 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9524bb-cb9e-4589-8a76-62396d194427 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.501209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9524bb-cb9e-4589-8a76-62396d194427 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.509368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9524bb-cb9e-4589-8a76-62396d194427 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.511767 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9524bb-cb9e-4589-8a76-62396d194427 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.518523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5b9524bb-cb9e-4589-8a76-62396d194427 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:52:59.523957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:59.525596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:59.527108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:59.527108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:59.527108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:52:59.527108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:52:59.527108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:52:59.527108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:52:59.527108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:52:59.527108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:52:59.527108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:52:59.527108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:59.530065 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 294/591] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:59.531054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9524bb-cb9e-4589-8a76-62396d194427 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.535448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb191cb-44e4-49bb-aff3-b963473603bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.535652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb191cb-44e4-49bb-aff3-b963473603bc None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.536033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb191cb-44e4-49bb-aff3-b963473603bc None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.536381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb191cb-44e4-49bb-aff3-b963473603bc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.545419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb191cb-44e4-49bb-aff3-b963473603bc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.546906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb191cb-44e4-49bb-aff3-b963473603bc None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.559315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-cfb191cb-44e4-49bb-aff3-b963473603bc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:52:59.561918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:59.563122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:59.564455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:59.564455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:59.564455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:52:59.564455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:52:59.564455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:52:59.564455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:52:59.564455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:52:59.564455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:52:59.564455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:52:59.564455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:52:59.565931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 298/592] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:59.571619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb191cb-44e4-49bb-aff3-b963473603bc None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.647313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9524bb-cb9e-4589-8a76-62396d194427 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.680470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb191cb-44e4-49bb-aff3-b963473603bc None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.684371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5977ff1-2d54-4895-b99b-3c448b99cfee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.685089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5977ff1-2d54-4895-b99b-3c448b99cfee None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.685444 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5977ff1-2d54-4895-b99b-3c448b99cfee None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.685793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5977ff1-2d54-4895-b99b-3c448b99cfee None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.693134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5977ff1-2d54-4895-b99b-3c448b99cfee None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.694689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5977ff1-2d54-4895-b99b-3c448b99cfee None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f5977ff1-2d54-4895-b99b-3c448b99cfee None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:52:59.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:52:59.708254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:52:59.709354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:52:59.709354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:52:59.709354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:52:59.709354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:52:59.709354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:52:59.709354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:52:59.709354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:52:59.709354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:52:59.710635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 295/593] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:52:59.711643 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5977ff1-2d54-4895-b99b-3c448b99cfee None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.720011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb6868-dc99-4289-a90b-b52f55cd0126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.720831 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb6868-dc99-4289-a90b-b52f55cd0126 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.721244 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb6868-dc99-4289-a90b-b52f55cd0126 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.721706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdb6868-dc99-4289-a90b-b52f55cd0126 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.722622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb6868-dc99-4289-a90b-b52f55cd0126 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:59.723112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb6868-dc99-4289-a90b-b52f55cd0126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.724860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdb6868-dc99-4289-a90b-b52f55cd0126 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.748486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 299/594] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:59.749657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb6868-dc99-4289-a90b-b52f55cd0126 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.827479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:59.831499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:52:59.853076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5977ff1-2d54-4895-b99b-3c448b99cfee None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.896624 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdb6868-dc99-4289-a90b-b52f55cd0126 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:52:59.897469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0246-1357-4044-8ba1-d70b8cda3122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.898485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0246-1357-4044-8ba1-d70b8cda3122 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.898942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0246-1357-4044-8ba1-d70b8cda3122 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.900186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03b0246-1357-4044-8ba1-d70b8cda3122 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.901200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b0246-1357-4044-8ba1-d70b8cda3122 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:59.901788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b0246-1357-4044-8ba1-d70b8cda3122 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.903525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03b0246-1357-4044-8ba1-d70b8cda3122 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.926920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 296/595] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:59.927942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0246-1357-4044-8ba1-d70b8cda3122 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:52:59.935341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fe549-55d2-418c-a9fb-3676666c4939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:52:59.936131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fe549-55d2-418c-a9fb-3676666c4939 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:52:59.936545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fe549-55d2-418c-a9fb-3676666c4939 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:52:59.936970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79fe549-55d2-418c-a9fb-3676666c4939 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:52:59.937936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fe549-55d2-418c-a9fb-3676666c4939 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:52:59.938376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fe549-55d2-418c-a9fb-3676666c4939 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:52:59.940046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79fe549-55d2-418c-a9fb-3676666c4939 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:52:59.953150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 300/596] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:52:59.954153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fe549-55d2-418c-a9fb-3676666c4939 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.036248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03b0246-1357-4044-8ba1-d70b8cda3122 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.062702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79fe549-55d2-418c-a9fb-3676666c4939 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.070837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:00.074556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a8ed0-6196-4f8e-9732-3782b27264b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:00.075496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8ed0-6196-4f8e-9732-3782b27264b5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.076025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8ed0-6196-4f8e-9732-3782b27264b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.076399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8ed0-6196-4f8e-9732-3782b27264b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.087337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a8ed0-6196-4f8e-9732-3782b27264b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.088950 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813a8ed0-6196-4f8e-9732-3782b27264b5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.091441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:00.104188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e341f4a-5296-4497-8819-d1e9902e41a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:00.105118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e341f4a-5296-4497-8819-d1e9902e41a3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.105693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e341f4a-5296-4497-8819-d1e9902e41a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.106103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e341f4a-5296-4497-8819-d1e9902e41a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-813a8ed0-6196-4f8e-9732-3782b27264b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:00.108083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:00.109259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:00.110176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:00.110176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:00.110176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:00.114911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 297/597] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:00.115823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a8ed0-6196-4f8e-9732-3782b27264b5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.121056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e341f4a-5296-4497-8819-d1e9902e41a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.122744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e341f4a-5296-4497-8819-d1e9902e41a3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-4e341f4a-5296-4497-8819-d1e9902e41a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:00.140122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:00.141107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:00.141983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:00.141983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:00.141983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:00.143813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 301/598] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:00.144817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e341f4a-5296-4497-8819-d1e9902e41a3 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.251097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a8ed0-6196-4f8e-9732-3782b27264b5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.272172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e341f4a-5296-4497-8819-d1e9902e41a3 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.300861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580dda8-5e96-409f-b0fb-1010e32bc1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:00.301519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580dda8-5e96-409f-b0fb-1010e32bc1a3 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.301796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580dda8-5e96-409f-b0fb-1010e32bc1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.302066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8580dda8-5e96-409f-b0fb-1010e32bc1a3 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/7074acac73904bab8399f223bd662863/roles/9b6f095785d54dbe9e3c0b35fff633d2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.310232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c8c4-1fd1-4f01-a8a7-6bf6e066ad80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:00.310877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c8c4-1fd1-4f01-a8a7-6bf6e066ad80 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.311159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c8c4-1fd1-4f01-a8a7-6bf6e066ad80 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.311433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e228c8c4-1fd1-4f01-a8a7-6bf6e066ad80 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.312080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228c8c4-1fd1-4f01-a8a7-6bf6e066ad80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:00.312435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228c8c4-1fd1-4f01-a8a7-6bf6e066ad80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.313814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e228c8c4-1fd1-4f01-a8a7-6bf6e066ad80 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.317597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580dda8-5e96-409f-b0fb-1010e32bc1a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=7074acac73904bab8399f223bd662863, role_id=9b6f095785d54dbe9e3c0b35fff633d2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.319069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8580dda8-5e96-409f-b0fb-1010e32bc1a3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.327683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 302/599] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:00.328643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c8c4-1fd1-4f01-a8a7-6bf6e066ad80 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.338790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 298/600] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:00 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/7074acac73904bab8399f223bd662863/roles/9b6f095785d54dbe9e3c0b35fff633d2 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:00.340058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580dda8-5e96-409f-b0fb-1010e32bc1a3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.360689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:00.416725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:00.538528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8580dda8-5e96-409f-b0fb-1010e32bc1a3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.555922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e228c8c4-1fd1-4f01-a8a7-6bf6e066ad80 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.586204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae5a3c-b139-41f0-be94-bbb22140d14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:00.586868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae5a3c-b139-41f0-be94-bbb22140d14a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae5a3c-b139-41f0-be94-bbb22140d14a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.587416 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae5a3c-b139-41f0-be94-bbb22140d14a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.602396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae5a3c-b139-41f0-be94-bbb22140d14a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.603818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fae5a3c-b139-41f0-be94-bbb22140d14a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.615673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c21b9-2174-4cfa-99c0-2c94af4708eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:00.616293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c21b9-2174-4cfa-99c0-2c94af4708eb None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.616568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c21b9-2174-4cfa-99c0-2c94af4708eb None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.616838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c21b9-2174-4cfa-99c0-2c94af4708eb None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.617484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c21b9-2174-4cfa-99c0-2c94af4708eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:00.617784 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c21b9-2174-4cfa-99c0-2c94af4708eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0fae5a3c-b139-41f0-be94-bbb22140d14a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:00.618785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:00.620811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:00.622877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:00.622877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:00.622877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:00.622877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:00.622877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:00.622877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:00.622877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:00.622877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:00.623866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c21b9-2174-4cfa-99c0-2c94af4708eb None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.626819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 299/601] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:00.626819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447d0f7-93de-4dcc-858d-1045e1527fe7 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.626819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447d0f7-93de-4dcc-858d-1045e1527fe7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.626819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4447d0f7-93de-4dcc-858d-1045e1527fe7 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.628337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 300/602] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:00.629275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447d0f7-93de-4dcc-858d-1045e1527fe7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.636641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 303/603] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:00.637927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62635-f9fe-4e8b-96e2-654f02d35b09 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.638207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62635-f9fe-4e8b-96e2-654f02d35b09 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.638479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e62635-f9fe-4e8b-96e2-654f02d35b09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.659702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-74e62635-f9fe-4e8b-96e2-654f02d35b09 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:00.661589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-74e62635-f9fe-4e8b-96e2-654f02d35b09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:00.747519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 304/604] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:00.748527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e62635-f9fe-4e8b-96e2-654f02d35b09 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.765798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:00.776670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4447d0f7-93de-4dcc-858d-1045e1527fe7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.780604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:00.859982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521119c-926d-4728-a0da-9ce75237485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:00.860511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521119c-926d-4728-a0da-9ce75237485a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:00.860785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521119c-926d-4728-a0da-9ce75237485a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:00.861051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521119c-926d-4728-a0da-9ce75237485a None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:00.861992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521119c-926d-4728-a0da-9ce75237485a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:00.862102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521119c-926d-4728-a0da-9ce75237485a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:00.863613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521119c-926d-4728-a0da-9ce75237485a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:00.889626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 301/605] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:00.891265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521119c-926d-4728-a0da-9ce75237485a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:00.920811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e62635-f9fe-4e8b-96e2-654f02d35b09 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:00.997521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521119c-926d-4728-a0da-9ce75237485a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.023468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96443014-992c-4155-916b-b2fa12add5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:01.024448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96443014-992c-4155-916b-b2fa12add5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.024925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96443014-992c-4155-916b-b2fa12add5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.025389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96443014-992c-4155-916b-b2fa12add5a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.032945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1d543-10c0-4ee1-9a17-41283fa2eff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:01.033640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1d543-10c0-4ee1-9a17-41283fa2eff8 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.033921 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1d543-10c0-4ee1-9a17-41283fa2eff8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.034195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af1d543-10c0-4ee1-9a17-41283fa2eff8 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/7b93049bc8aa47648d101a3f937ca8db/roles/9b6f095785d54dbe9e3c0b35fff633d2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.048041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96443014-992c-4155-916b-b2fa12add5a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:01.049851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96443014-992c-4155-916b-b2fa12add5a8 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:01.049981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1d543-10c0-4ee1-9a17-41283fa2eff8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=7b93049bc8aa47648d101a3f937ca8db, role_id=9b6f095785d54dbe9e3c0b35fff633d2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:01.054792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af1d543-10c0-4ee1-9a17-41283fa2eff8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-96443014-992c-4155-916b-b2fa12add5a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:01.069985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:01.070983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:01.071882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:01.071882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:01.071882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:01.071882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:01.071882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:01.071882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:01.071882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:01.071882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:01.074713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 305/606] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:01.084015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96443014-992c-4155-916b-b2fa12add5a8 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.091344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 302/607] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:00 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/7b93049bc8aa47648d101a3f937ca8db/roles/9b6f095785d54dbe9e3c0b35fff633d2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:01.092526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1d543-10c0-4ee1-9a17-41283fa2eff8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.115246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:01.197484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:01.214917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af1d543-10c0-4ee1-9a17-41283fa2eff8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.240780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96443014-992c-4155-916b-b2fa12add5a8 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.258111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c9ac4-1c84-4f5f-ae0b-b24ac1f52a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:01.259271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c9ac4-1c84-4f5f-ae0b-b24ac1f52a1e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.259695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c9ac4-1c84-4f5f-ae0b-b24ac1f52a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.260205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c9ac4-1c84-4f5f-ae0b-b24ac1f52a1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.273734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c9ac4-1c84-4f5f-ae0b-b24ac1f52a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:01.278736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706f14c7-cf7a-49e9-9a21-4a36d0321159 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:01.279430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f14c7-cf7a-49e9-9a21-4a36d0321159 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.279707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f14c7-cf7a-49e9-9a21-4a36d0321159 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.279979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706f14c7-cf7a-49e9-9a21-4a36d0321159 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9a5c9ac4-1c84-4f5f-ae0b-b24ac1f52a1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:01.280257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:01.281374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:01.282418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:01.283174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f14c7-cf7a-49e9-9a21-4a36d0321159 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:01.283174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f14c7-cf7a-49e9-9a21-4a36d0321159 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:01.283174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706f14c7-cf7a-49e9-9a21-4a36d0321159 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:01.285036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 303/608] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:01.291522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1cefb-d09a-4912-8bb2-9f4fd5f78840 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.292128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1cefb-d09a-4912-8bb2-9f4fd5f78840 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.293259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d1cefb-d09a-4912-8bb2-9f4fd5f78840 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.295342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 304/609] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:01.296261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1cefb-d09a-4912-8bb2-9f4fd5f78840 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.302682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 306/610] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:01.304507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb1e8-da00-407a-b462-305a005f1164 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.304796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb1e8-da00-407a-b462-305a005f1164 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.305069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ddb1e8-da00-407a-b462-305a005f1164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.326252 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-56ddb1e8-da00-407a-b462-305a005f1164 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:01.327529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-56ddb1e8-da00-407a-b462-305a005f1164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:01.390220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:01.422434 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 307/611] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:01.423563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddb1e8-da00-407a-b462-305a005f1164 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.432918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d1cefb-d09a-4912-8bb2-9f4fd5f78840 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.493318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:01.494518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593ce84-b17c-4670-8c36-81c6f5ab1765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:01.495766 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593ce84-b17c-4670-8c36-81c6f5ab1765 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.495766 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593ce84-b17c-4670-8c36-81c6f5ab1765 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.495766 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f593ce84-b17c-4670-8c36-81c6f5ab1765 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.497029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593ce84-b17c-4670-8c36-81c6f5ab1765 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:01.497401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593ce84-b17c-4670-8c36-81c6f5ab1765 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:01.502972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f593ce84-b17c-4670-8c36-81c6f5ab1765 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:01.511300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 305/612] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:01.519922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593ce84-b17c-4670-8c36-81c6f5ab1765 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.556767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ddb1e8-da00-407a-b462-305a005f1164 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.598820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea17af-2fe4-42d8-832b-720406720492 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:01.598820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea17af-2fe4-42d8-832b-720406720492 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.598820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea17af-2fe4-42d8-832b-720406720492 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.598820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea17af-2fe4-42d8-832b-720406720492 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/309ebac21dd944029b1de80ba54dd794/roles/9b6f095785d54dbe9e3c0b35fff633d2` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.629446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea17af-2fe4-42d8-832b-720406720492 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=309ebac21dd944029b1de80ba54dd794, role_id=9b6f095785d54dbe9e3c0b35fff633d2)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:01.630948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ea17af-2fe4-42d8-832b-720406720492 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:01.674979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 308/613] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:01 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/309ebac21dd944029b1de80ba54dd794/roles/9b6f095785d54dbe9e3c0b35fff633d2 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:01.704594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f593ce84-b17c-4670-8c36-81c6f5ab1765 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.745655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022537d5-236c-4394-8d40-42d3921122b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:01.747145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022537d5-236c-4394-8d40-42d3921122b9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:01.747430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022537d5-236c-4394-8d40-42d3921122b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:01.747708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022537d5-236c-4394-8d40-42d3921122b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:01.751076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:01.767414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022537d5-236c-4394-8d40-42d3921122b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:01.772114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-022537d5-236c-4394-8d40-42d3921122b9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-022537d5-236c-4394-8d40-42d3921122b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:01.791855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:01.793262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:01.794425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:01.794425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:01.794425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:01.799045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 306/614] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:01.800312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea17af-2fe4-42d8-832b-720406720492 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.816049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022537d5-236c-4394-8d40-42d3921122b9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:01.959970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea17af-2fe4-42d8-832b-720406720492 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.968329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022537d5-236c-4394-8d40-42d3921122b9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:01.976215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.010595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34485bf1-93dc-4209-a694-ac29d096cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.011959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34485bf1-93dc-4209-a694-ac29d096cbc4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.012685 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34485bf1-93dc-4209-a694-ac29d096cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.013157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34485bf1-93dc-4209-a694-ac29d096cbc4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.024955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34485bf1-93dc-4209-a694-ac29d096cbc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:02.027378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c085d-c955-4be6-b13b-3756074addb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.028052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c085d-c955-4be6-b13b-3756074addb3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.028327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c085d-c955-4be6-b13b-3756074addb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.028596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424c085d-c955-4be6-b13b-3756074addb3 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.029303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c085d-c955-4be6-b13b-3756074addb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.029606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c085d-c955-4be6-b13b-3756074addb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.031019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424c085d-c955-4be6-b13b-3756074addb3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-34485bf1-93dc-4209-a694-ac29d096cbc4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:02.032222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:02.033126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:02.034011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:02.036836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 307/615] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:02.042275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34485bf1-93dc-4209-a694-ac29d096cbc4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.058209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 309/616] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.064066 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c085d-c955-4be6-b13b-3756074addb3 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.123284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.174070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34485bf1-93dc-4209-a694-ac29d096cbc4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.224521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87122-0b6e-4949-88e6-8d98f6931d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.225053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87122-0b6e-4949-88e6-8d98f6931d56 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.225330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87122-0b6e-4949-88e6-8d98f6931d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.225601 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad87122-0b6e-4949-88e6-8d98f6931d56 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.226286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad87122-0b6e-4949-88e6-8d98f6931d56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.226586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad87122-0b6e-4949-88e6-8d98f6931d56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.228013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad87122-0b6e-4949-88e6-8d98f6931d56 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.245854 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 308/617] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.251471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87122-0b6e-4949-88e6-8d98f6931d56 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.269736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424c085d-c955-4be6-b13b-3756074addb3 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.308014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0731ec-be69-421d-93ba-5d0c66cc6283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.309117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0731ec-be69-421d-93ba-5d0c66cc6283 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.309655 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0731ec-be69-421d-93ba-5d0c66cc6283 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.310123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0731ec-be69-421d-93ba-5d0c66cc6283 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.318653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0731ec-be69-421d-93ba-5d0c66cc6283 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.320459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0731ec-be69-421d-93ba-5d0c66cc6283 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-3a0731ec-be69-421d-93ba-5d0c66cc6283 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:02.332640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:02.333694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:02.334642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:02.334642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:02.334642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:02.334642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:02.334642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:02.334642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:02.334642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:02.334642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:02.334642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:02.334642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:02.337252 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 310/618] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:02.346649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0731ec-be69-421d-93ba-5d0c66cc6283 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.376287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.453666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad87122-0b6e-4949-88e6-8d98f6931d56 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.457866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0731ec-be69-421d-93ba-5d0c66cc6283 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.475215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.496527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf39fde-7cd0-4c6e-8d86-c9593bdadb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.497253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf39fde-7cd0-4c6e-8d86-c9593bdadb78 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.497634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf39fde-7cd0-4c6e-8d86-c9593bdadb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.497979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf39fde-7cd0-4c6e-8d86-c9593bdadb78 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.498804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf39fde-7cd0-4c6e-8d86-c9593bdadb78 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.499344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf39fde-7cd0-4c6e-8d86-c9593bdadb78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.500864 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf39fde-7cd0-4c6e-8d86-c9593bdadb78 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.529789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 311/619] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.535375 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf39fde-7cd0-4c6e-8d86-c9593bdadb78 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.556964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379d6071-fc80-4860-aecc-2d79670a3d06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.557630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6071-fc80-4860-aecc-2d79670a3d06 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.557970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6071-fc80-4860-aecc-2d79670a3d06 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.558248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379d6071-fc80-4860-aecc-2d79670a3d06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.570011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6071-fc80-4860-aecc-2d79670a3d06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.571533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379d6071-fc80-4860-aecc-2d79670a3d06 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-379d6071-fc80-4860-aecc-2d79670a3d06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:02.585970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:02.587147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:02.588160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:02.588160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:02.588160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:02.588160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 309/620] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:02.588592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8c685-3b49-4a7e-a5c2-18adcc46e7cd None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.588861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8c685-3b49-4a7e-a5c2-18adcc46e7cd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.589279 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8c685-3b49-4a7e-a5c2-18adcc46e7cd None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.590763 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 310/621] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:02.595459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8c685-3b49-4a7e-a5c2-18adcc46e7cd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.634387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.651982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf39fde-7cd0-4c6e-8d86-c9593bdadb78 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.686721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aece949-0c72-4560-b895-b79bdd908d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.687384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aece949-0c72-4560-b895-b79bdd908d98 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.687662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aece949-0c72-4560-b895-b79bdd908d98 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.687935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aece949-0c72-4560-b895-b79bdd908d98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.698530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c8c685-3b49-4a7e-a5c2-18adcc46e7cd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:02.740249 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91063856-f622-4de8-a9e1-9204406927d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:02.740860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91063856-f622-4de8-a9e1-9204406927d9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.741071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91063856-f622-4de8-a9e1-9204406927d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.741342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91063856-f622-4de8-a9e1-9204406927d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.742000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91063856-f622-4de8-a9e1-9204406927d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:02.742750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91063856-f622-4de8-a9e1-9204406927d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.744596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91063856-f622-4de8-a9e1-9204406927d9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.760161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aece949-0c72-4560-b895-b79bdd908d98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:02.762022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aece949-0c72-4560-b895-b79bdd908d98 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:02.766879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 311/622] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:02.768266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66c9d6-55a8-4405-9cb1-2b9a39c4a79f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:02.768550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66c9d6-55a8-4405-9cb1-2b9a39c4a79f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:02.768819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66c9d6-55a8-4405-9cb1-2b9a39c4a79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:02.788319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5e66c9d6-55a8-4405-9cb1-2b9a39c4a79f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:02.789625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5e66c9d6-55a8-4405-9cb1-2b9a39c4a79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:02.808189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.867111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 312/623] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:02.868027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66c9d6-55a8-4405-9cb1-2b9a39c4a79f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:02.869567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:02.885323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 312/624] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:02.891224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aece949-0c72-4560-b895-b79bdd908d98 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.002578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aece949-0c72-4560-b895-b79bdd908d98 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.039893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66c9d6-55a8-4405-9cb1-2b9a39c4a79f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.051420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdbe1d-89d7-4f91-8819-e80dc1948065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.051869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbe1d-89d7-4f91-8819-e80dc1948065 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.052147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbe1d-89d7-4f91-8819-e80dc1948065 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.052416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcdbe1d-89d7-4f91-8819-e80dc1948065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.068795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdbe1d-89d7-4f91-8819-e80dc1948065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.070274 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcdbe1d-89d7-4f91-8819-e80dc1948065 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.080129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1609e55-80d2-4aaf-a76d-47d3c4ff8aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.085296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1609e55-80d2-4aaf-a76d-47d3c4ff8aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.085784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1609e55-80d2-4aaf-a76d-47d3c4ff8aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.086252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1609e55-80d2-4aaf-a76d-47d3c4ff8aa6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.096213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1609e55-80d2-4aaf-a76d-47d3c4ff8aa6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.098784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1609e55-80d2-4aaf-a76d-47d3c4ff8aa6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-2dcdbe1d-89d7-4f91-8819-e80dc1948065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:03.104134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:03.105276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:03.106237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:03.106237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:03.106237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:03.108305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 313/625] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:03.116987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdbe1d-89d7-4f91-8819-e80dc1948065 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e1609e55-80d2-4aaf-a76d-47d3c4ff8aa6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:03.125503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:03.126426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:03.127414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:03.127414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:03.127414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:03.127414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:03.127414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:03.127414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:03.127414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:03.127414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:03.127414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:53:03.127414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:03.137798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 313/626] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:03.143027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1609e55-80d2-4aaf-a76d-47d3c4ff8aa6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.162479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.187360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.269330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1609e55-80d2-4aaf-a76d-47d3c4ff8aa6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.314512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcdbe1d-89d7-4f91-8819-e80dc1948065 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.337951 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8691a-ae0a-4ef6-a95b-68331f8c362e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.338563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8691a-ae0a-4ef6-a95b-68331f8c362e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.338864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8691a-ae0a-4ef6-a95b-68331f8c362e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.339175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8691a-ae0a-4ef6-a95b-68331f8c362e None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.339917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8691a-ae0a-4ef6-a95b-68331f8c362e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:03.340224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8691a-ae0a-4ef6-a95b-68331f8c362e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.341677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8691a-ae0a-4ef6-a95b-68331f8c362e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.361952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 314/627] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:03.366930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8691a-ae0a-4ef6-a95b-68331f8c362e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.380474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e10cd-f037-4185-ad79-b67991cdd143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.381507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e10cd-f037-4185-ad79-b67991cdd143 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.382182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e10cd-f037-4185-ad79-b67991cdd143 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.382650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e10cd-f037-4185-ad79-b67991cdd143 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.383683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e10cd-f037-4185-ad79-b67991cdd143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:03.384194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e10cd-f037-4185-ad79-b67991cdd143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.385924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e10cd-f037-4185-ad79-b67991cdd143 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.404319 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 314/628] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:03.405376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e10cd-f037-4185-ad79-b67991cdd143 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.441348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.476082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8691a-ae0a-4ef6-a95b-68331f8c362e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.505984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.510191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e10cd-f037-4185-ad79-b67991cdd143 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.515003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c72c119-a7a5-4343-820a-37359365906d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.515642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72c119-a7a5-4343-820a-37359365906d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.515920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72c119-a7a5-4343-820a-37359365906d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.516190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c72c119-a7a5-4343-820a-37359365906d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.527432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c72c119-a7a5-4343-820a-37359365906d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7c72c119-a7a5-4343-820a-37359365906d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:03.532038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:03.532941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:03.533773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 315/629] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:03.534460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df863104-f3ac-4fa2-8755-a70b44767e1b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.535146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df863104-f3ac-4fa2-8755-a70b44767e1b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.535146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df863104-f3ac-4fa2-8755-a70b44767e1b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.538805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 316/630] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:03.538805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df863104-f3ac-4fa2-8755-a70b44767e1b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.554584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0afc7-a81c-4c09-b049-f51d8bd5bb72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.555256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0afc7-a81c-4c09-b049-f51d8bd5bb72 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.555536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0afc7-a81c-4c09-b049-f51d8bd5bb72 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.555818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f0afc7-a81c-4c09-b049-f51d8bd5bb72 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.567489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0afc7-a81c-4c09-b049-f51d8bd5bb72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.568958 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f0afc7-a81c-4c09-b049-f51d8bd5bb72 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-11f0afc7-a81c-4c09-b049-f51d8bd5bb72 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:03.584371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:03.585355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:03.586237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:03.586237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:03.586237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:03.590468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 315/631] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:03.591230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0afc7-a81c-4c09-b049-f51d8bd5bb72 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.649787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df863104-f3ac-4fa2-8755-a70b44767e1b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.682553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.689987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a3c92-df19-43ad-8a64-358d8bc0bba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.690670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3c92-df19-43ad-8a64-358d8bc0bba2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.690997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3c92-df19-43ad-8a64-358d8bc0bba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.691276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3c92-df19-43ad-8a64-358d8bc0bba2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.697382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f0afc7-a81c-4c09-b049-f51d8bd5bb72 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.698715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a3c92-df19-43ad-8a64-358d8bc0bba2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.700525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a3c92-df19-43ad-8a64-358d8bc0bba2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f55a3c92-df19-43ad-8a64-358d8bc0bba2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:03.712005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:03.713102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 317/632] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d307c-08e4-471c-af47-270027617c77 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.719422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d307c-08e4-471c-af47-270027617c77 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.720172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53d307c-08e4-471c-af47-270027617c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.735123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b53d307c-08e4-471c-af47-270027617c77 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:03.736318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b53d307c-08e4-471c-af47-270027617c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:03.741726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bde1c-43dc-4131-b403-b095520e1a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.742447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bde1c-43dc-4131-b403-b095520e1a6d None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.742864 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bde1c-43dc-4131-b403-b095520e1a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.743237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55bde1c-43dc-4131-b403-b095520e1a6d None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.744007 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bde1c-43dc-4131-b403-b095520e1a6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:03.744410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bde1c-43dc-4131-b403-b095520e1a6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.746051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55bde1c-43dc-4131-b403-b095520e1a6d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.757574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 316/633] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:03.757574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bde1c-43dc-4131-b403-b095520e1a6d None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.774980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.820837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 318/634] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:03.821655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d307c-08e4-471c-af47-270027617c77 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.875737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55bde1c-43dc-4131-b403-b095520e1a6d None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.924009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23f6a6-b0a9-4f71-873b-4595eaeed293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.924872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23f6a6-b0a9-4f71-873b-4595eaeed293 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.925292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23f6a6-b0a9-4f71-873b-4595eaeed293 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.925703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23f6a6-b0a9-4f71-873b-4595eaeed293 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.926517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23f6a6-b0a9-4f71-873b-4595eaeed293 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:03.926999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23f6a6-b0a9-4f71-873b-4595eaeed293 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.928683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c23f6a6-b0a9-4f71-873b-4595eaeed293 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.930323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53d307c-08e4-471c-af47-270027617c77 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:03.942809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 317/635] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:03.943898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23f6a6-b0a9-4f71-873b-4595eaeed293 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:03.957355 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:03.974629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fb412-e880-465a-862f-add155ee9423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:03.975286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fb412-e880-465a-862f-add155ee9423 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.975564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fb412-e880-465a-862f-add155ee9423 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.975823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fb412-e880-465a-862f-add155ee9423 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.976536 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fb412-e880-465a-862f-add155ee9423 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:03.976831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fb412-e880-465a-862f-add155ee9423 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:03.978287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287fb412-e880-465a-862f-add155ee9423 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:03.990429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 319/636] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:03.992194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4150e-d469-47aa-b8ed-6607eae22dd5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:03.993014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4150e-d469-47aa-b8ed-6607eae22dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:03.993541 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db4150e-d469-47aa-b8ed-6607eae22dd5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:03.995912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 320/637] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:03.997126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4150e-d469-47aa-b8ed-6607eae22dd5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.025989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.062609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c23f6a6-b0a9-4f71-873b-4595eaeed293 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.105720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb0957-becd-4a92-a082-35819f30f5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.107197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb0957-becd-4a92-a082-35819f30f5df None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.107628 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb0957-becd-4a92-a082-35819f30f5df None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.108277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb0957-becd-4a92-a082-35819f30f5df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.116576 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db4150e-d469-47aa-b8ed-6607eae22dd5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.120574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb0957-becd-4a92-a082-35819f30f5df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.122032 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acb0957-becd-4a92-a082-35819f30f5df None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-2acb0957-becd-4a92-a082-35819f30f5df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:04.136866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:04.137945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:04.139019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:04.139019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:04.139019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:04.139019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 318/638] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:04.139019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb0957-becd-4a92-a082-35819f30f5df None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.157126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf81d8d4-d981-4f46-977c-af4205ba5227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.157995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81d8d4-d981-4f46-977c-af4205ba5227 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.158241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81d8d4-d981-4f46-977c-af4205ba5227 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.158506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf81d8d4-d981-4f46-977c-af4205ba5227 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.165332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81d8d4-d981-4f46-977c-af4205ba5227 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.166792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf81d8d4-d981-4f46-977c-af4205ba5227 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-bf81d8d4-d981-4f46-977c-af4205ba5227 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:04.177784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:04.178869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:04.180055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:04.180055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:04.180055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:04.180055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:04.180055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:04.180055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:04.180055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:04.180055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:04.180055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 321/639] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:04.180055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff1364-b036-41e9-a3c1-7d23fc3b5bdf None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.180594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff1364-b036-41e9-a3c1-7d23fc3b5bdf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.180594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eff1364-b036-41e9-a3c1-7d23fc3b5bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.197824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9eff1364-b036-41e9-a3c1-7d23fc3b5bdf None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:04.199224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9eff1364-b036-41e9-a3c1-7d23fc3b5bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:04.235015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.240877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb0957-becd-4a92-a082-35819f30f5df None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.263994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.267921 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 322/640] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:04.268753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff1364-b036-41e9-a3c1-7d23fc3b5bdf None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.275296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb29d8-a8b4-4fa8-8c19-cf8f7ca6a38e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.275919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb29d8-a8b4-4fa8-8c19-cf8f7ca6a38e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.276197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb29d8-a8b4-4fa8-8c19-cf8f7ca6a38e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.276568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb29d8-a8b4-4fa8-8c19-cf8f7ca6a38e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.277381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb29d8-a8b4-4fa8-8c19-cf8f7ca6a38e None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=c6ceb08f9eda4942a510bfaa0f0ef84e) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:04.277638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb29d8-a8b4-4fa8-8c19-cf8f7ca6a38e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.279130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb29d8-a8b4-4fa8-8c19-cf8f7ca6a38e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.298817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 319/641] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/role_assignments?user.id=c6ceb08f9eda4942a510bfaa0f0ef84e&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:04.298817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb29d8-a8b4-4fa8-8c19-cf8f7ca6a38e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.390184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eff1364-b036-41e9-a3c1-7d23fc3b5bdf None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.428865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb29d8-a8b4-4fa8-8c19-cf8f7ca6a38e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.437167 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c8305-2894-40d4-8196-ec0c640da69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.437810 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c8305-2894-40d4-8196-ec0c640da69d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.438734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c8305-2894-40d4-8196-ec0c640da69d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.439059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88c8305-2894-40d4-8196-ec0c640da69d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.455035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88c8305-2894-40d4-8196-ec0c640da69d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b88c8305-2894-40d4-8196-ec0c640da69d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:04.461759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:04.462802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 323/642] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:04.464327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c8305-2894-40d4-8196-ec0c640da69d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.478928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68071d3a-6023-4da4-b2f3-7b70210d9ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.479898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071d3a-6023-4da4-b2f3-7b70210d9ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.480380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071d3a-6023-4da4-b2f3-7b70210d9ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.480839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68071d3a-6023-4da4-b2f3-7b70210d9ed3 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.481674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68071d3a-6023-4da4-b2f3-7b70210d9ed3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:04.481978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68071d3a-6023-4da4-b2f3-7b70210d9ed3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.483511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68071d3a-6023-4da4-b2f3-7b70210d9ed3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.500791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 320/643] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:04.504317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68071d3a-6023-4da4-b2f3-7b70210d9ed3 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.505055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.562212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.589181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88c8305-2894-40d4-8196-ec0c640da69d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.615244 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68071d3a-6023-4da4-b2f3-7b70210d9ed3 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.627470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f81e38-d715-4164-b8e8-4e698c87e286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.628081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81e38-d715-4164-b8e8-4e698c87e286 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.628355 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81e38-d715-4164-b8e8-4e698c87e286 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.628788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81e38-d715-4164-b8e8-4e698c87e286 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.629489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f81e38-d715-4164-b8e8-4e698c87e286 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:04.629870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f81e38-d715-4164-b8e8-4e698c87e286 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.631389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f81e38-d715-4164-b8e8-4e698c87e286 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.649350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 324/644] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:04.649350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f81e38-d715-4164-b8e8-4e698c87e286 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.656317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0270a-65f9-4de2-a723-382487beeac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.656938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0270a-65f9-4de2-a723-382487beeac9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.657180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0270a-65f9-4de2-a723-382487beeac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.657485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a0270a-65f9-4de2-a723-382487beeac9 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.658211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0270a-65f9-4de2-a723-382487beeac9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:04.658507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0270a-65f9-4de2-a723-382487beeac9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.659911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a0270a-65f9-4de2-a723-382487beeac9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.672970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 321/645] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:04.672970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0270a-65f9-4de2-a723-382487beeac9 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.763807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.779274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f81e38-d715-4164-b8e8-4e698c87e286 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.784388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a0270a-65f9-4de2-a723-382487beeac9 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.794808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:04.819390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2957b3-f2a2-42b6-89af-8c402ff922c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.819730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73c63d-7791-4f27-9ced-41357b137374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.820033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2957b3-f2a2-42b6-89af-8c402ff922c9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.820288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73c63d-7791-4f27-9ced-41357b137374 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.820392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2957b3-f2a2-42b6-89af-8c402ff922c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.820564 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73c63d-7791-4f27-9ced-41357b137374 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.820666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2957b3-f2a2-42b6-89af-8c402ff922c9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.820821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e73c63d-7791-4f27-9ced-41357b137374 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.829834 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2957b3-f2a2-42b6-89af-8c402ff922c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:04.831347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2957b3-f2a2-42b6-89af-8c402ff922c9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:04.831531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e73c63d-7791-4f27-9ced-41357b137374 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-8e73c63d-7791-4f27-9ced-41357b137374 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:04.836792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:04.837778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 322/646] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:04.838714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73c63d-7791-4f27-9ced-41357b137374 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9c2957b3-f2a2-42b6-89af-8c402ff922c9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:04.852696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:04.853701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:04.854728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:04.854728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:04.854728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:04.854728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:04.854728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:04.854728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:04.854728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:04.854728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:04.854728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 18 20:53:04.854728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:04.856034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 325/647] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:04.856034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2957b3-f2a2-42b6-89af-8c402ff922c9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:04.947897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e73c63d-7791-4f27-9ced-41357b137374 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.966534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2957b3-f2a2-42b6-89af-8c402ff922c9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:04.982505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db472867-11b0-4cf7-ba1a-96f675f28618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:04.983193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db472867-11b0-4cf7-ba1a-96f675f28618 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:04.983458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db472867-11b0-4cf7-ba1a-96f675f28618 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:04.983732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db472867-11b0-4cf7-ba1a-96f675f28618 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/410e8bceb7664e1d9968f85f41cc0828/roles/9b6f095785d54dbe9e3c0b35fff633d2` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:04.999345 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db472867-11b0-4cf7-ba1a-96f675f28618 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=410e8bceb7664e1d9968f85f41cc0828, role_id=9b6f095785d54dbe9e3c0b35fff633d2)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.000825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db472867-11b0-4cf7-ba1a-96f675f28618 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.002866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929d8d5-2d0b-40ff-b38d-e6609daf33f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.003661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929d8d5-2d0b-40ff-b38d-e6609daf33f6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.004093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929d8d5-2d0b-40ff-b38d-e6609daf33f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.004363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d929d8d5-2d0b-40ff-b38d-e6609daf33f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.015972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 323/648] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:04 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/410e8bceb7664e1d9968f85f41cc0828/roles/9b6f095785d54dbe9e3c0b35fff633d2 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:05.016152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929d8d5-2d0b-40ff-b38d-e6609daf33f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.016651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db472867-11b0-4cf7-ba1a-96f675f28618 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.028626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d929d8d5-2d0b-40ff-b38d-e6609daf33f6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d929d8d5-2d0b-40ff-b38d-e6609daf33f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:05.047490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:05.048535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:05.049433 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:05.049433 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:05.049433 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:05.049433 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 326/649] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:05.050092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929d8d5-2d0b-40ff-b38d-e6609daf33f6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.050537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.053622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.164963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db472867-11b0-4cf7-ba1a-96f675f28618 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.179539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d929d8d5-2d0b-40ff-b38d-e6609daf33f6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.205653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8833e-475f-4052-a5b4-66a7ce04f578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.206191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8833e-475f-4052-a5b4-66a7ce04f578 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.206464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8833e-475f-4052-a5b4-66a7ce04f578 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.206742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a8833e-475f-4052-a5b4-66a7ce04f578 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.207439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8833e-475f-4052-a5b4-66a7ce04f578 None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:05.208284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8833e-475f-4052-a5b4-66a7ce04f578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.209099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a8833e-475f-4052-a5b4-66a7ce04f578 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.221442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 324/650] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:05.222288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8833e-475f-4052-a5b4-66a7ce04f578 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.226278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203531be-97d5-4a37-b656-8676af89990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.226941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203531be-97d5-4a37-b656-8676af89990d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.227222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203531be-97d5-4a37-b656-8676af89990d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.227497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203531be-97d5-4a37-b656-8676af89990d None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.228246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203531be-97d5-4a37-b656-8676af89990d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:05.228555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203531be-97d5-4a37-b656-8676af89990d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.230105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203531be-97d5-4a37-b656-8676af89990d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.250662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 327/651] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:05.251556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203531be-97d5-4a37-b656-8676af89990d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.325426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.329264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.355462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a8833e-475f-4052-a5b4-66a7ce04f578 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.386151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203531be-97d5-4a37-b656-8676af89990d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.394639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8ba2b-308b-43bd-9395-e1eb6c4cd909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.395296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ba2b-308b-43bd-9395-e1eb6c4cd909 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.395571 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ba2b-308b-43bd-9395-e1eb6c4cd909 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.396159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d8ba2b-308b-43bd-9395-e1eb6c4cd909 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.396803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8ba2b-308b-43bd-9395-e1eb6c4cd909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:05.397099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8ba2b-308b-43bd-9395-e1eb6c4cd909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.398468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d8ba2b-308b-43bd-9395-e1eb6c4cd909 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.411016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 325/652] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:05.411864 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8ba2b-308b-43bd-9395-e1eb6c4cd909 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.426785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d4bc1-b312-4141-81ee-e54ff650198f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.427890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d4bc1-b312-4141-81ee-e54ff650198f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.428163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d4bc1-b312-4141-81ee-e54ff650198f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.428818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33d4bc1-b312-4141-81ee-e54ff650198f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.442304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d4bc1-b312-4141-81ee-e54ff650198f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.444598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33d4bc1-b312-4141-81ee-e54ff650198f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a33d4bc1-b312-4141-81ee-e54ff650198f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:05.463983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:05.466608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:05.468484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:05.468484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:05.468484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:05.468484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 328/653] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:05.468484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d4bc1-b312-4141-81ee-e54ff650198f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.545707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d8ba2b-308b-43bd-9395-e1eb6c4cd909 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.588969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427c7b5-7654-43e5-bbf7-d27d917ee2c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.599441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427c7b5-7654-43e5-bbf7-d27d917ee2c7 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.599441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427c7b5-7654-43e5-bbf7-d27d917ee2c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.599441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427c7b5-7654-43e5-bbf7-d27d917ee2c7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.599939 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33d4bc1-b312-4141-81ee-e54ff650198f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.613186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.615333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.637454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce070b0b-f519-4263-8e2c-cdb8c6f69d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.638762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce070b0b-f519-4263-8e2c-cdb8c6f69d5c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.638762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce070b0b-f519-4263-8e2c-cdb8c6f69d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.639061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce070b0b-f519-4263-8e2c-cdb8c6f69d5c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.648374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce070b0b-f519-4263-8e2c-cdb8c6f69d5c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.649865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce070b0b-f519-4263-8e2c-cdb8c6f69d5c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ce070b0b-f519-4263-8e2c-cdb8c6f69d5c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:05.661906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:05.662877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:05.663800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:05.663800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:05.663800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:05.663800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:05.663800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:05.663800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:05.663800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:05.663800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:05.663800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:53:05.663800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:05.668061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 329/654] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:05.668932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce070b0b-f519-4263-8e2c-cdb8c6f69d5c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.677289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427c7b5-7654-43e5-bbf7-d27d917ee2c7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.679020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427c7b5-7654-43e5-bbf7-d27d917ee2c7 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.785593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce070b0b-f519-4263-8e2c-cdb8c6f69d5c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.788289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 326/655] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:05.789636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427c7b5-7654-43e5-bbf7-d27d917ee2c7 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.822478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3730e-3589-44f8-a963-f3ff3199a988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.823115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3730e-3589-44f8-a963-f3ff3199a988 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.823536 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3730e-3589-44f8-a963-f3ff3199a988 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.823889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a3730e-3589-44f8-a963-f3ff3199a988 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.824683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3730e-3589-44f8-a963-f3ff3199a988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:05.824988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3730e-3589-44f8-a963-f3ff3199a988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.826467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a3730e-3589-44f8-a963-f3ff3199a988 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.836215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.842099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 330/656] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:05.843408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3730e-3589-44f8-a963-f3ff3199a988 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.878013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:05.901326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427c7b5-7654-43e5-bbf7-d27d917ee2c7 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.938298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6c147-f62d-4c21-bc4a-0cd141d7a301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.939323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6c147-f62d-4c21-bc4a-0cd141d7a301 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.939866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6c147-f62d-4c21-bc4a-0cd141d7a301 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.940425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d6c147-f62d-4c21-bc4a-0cd141d7a301 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:05.941361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6c147-f62d-4c21-bc4a-0cd141d7a301 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:05.941886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6c147-f62d-4c21-bc4a-0cd141d7a301 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:05.943656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d6c147-f62d-4c21-bc4a-0cd141d7a301 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:05.953326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a3730e-3589-44f8-a963-f3ff3199a988 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:05.963794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 327/657] 10.222.0.59 () {56 vars in 1137 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:05.965100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6c147-f62d-4c21-bc4a-0cd141d7a301 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:05.994742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d89904-e3f0-41d6-a2b9-32f0e1cd0989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:05.995827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89904-e3f0-41d6-a2b9-32f0e1cd0989 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:05.996108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89904-e3f0-41d6-a2b9-32f0e1cd0989 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:05.996378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d89904-e3f0-41d6-a2b9-32f0e1cd0989 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.007596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d89904-e3f0-41d6-a2b9-32f0e1cd0989 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.009142 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d89904-e3f0-41d6-a2b9-32f0e1cd0989 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-01d89904-e3f0-41d6-a2b9-32f0e1cd0989 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:06.025239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:06.026263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:06.027421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:06.027421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:06.027421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:06.027421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 331/658] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:06.027703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d89904-e3f0-41d6-a2b9-32f0e1cd0989 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.071907 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.075313 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d6c147-f62d-4c21-bc4a-0cd141d7a301 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.112955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f6d94-f69f-4163-b68f-d15b5d94d815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.113865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6d94-f69f-4163-b68f-d15b5d94d815 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.114290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6d94-f69f-4163-b68f-d15b5d94d815 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.114743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f6d94-f69f-4163-b68f-d15b5d94d815 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.122874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f6d94-f69f-4163-b68f-d15b5d94d815 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.123489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.126197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f6d94-f69f-4163-b68f-d15b5d94d815 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-e03f6d94-f69f-4163-b68f-d15b5d94d815 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:06.140233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:06.141426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:06.142402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:06.142402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:06.142402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:06.142402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:06.142402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:06.142402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:06.142402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:06.142402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:06.142402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 18 20:53:06.142402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:06.142980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d89904-e3f0-41d6-a2b9-32f0e1cd0989 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.144694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 328/659] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:05 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:06.146008 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f6d94-f69f-4163-b68f-d15b5d94d815 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.186305 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05450e-3285-4eab-9f6a-850a937429c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.186975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05450e-3285-4eab-9f6a-850a937429c1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.187256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05450e-3285-4eab-9f6a-850a937429c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.187531 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd05450e-3285-4eab-9f6a-850a937429c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.255428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f6d94-f69f-4163-b68f-d15b5d94d815 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.258688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05450e-3285-4eab-9f6a-850a937429c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.260055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd05450e-3285-4eab-9f6a-850a937429c1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.293155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d96d0d-a6e2-44c5-84ae-5bd5e23b1017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.294117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96d0d-a6e2-44c5-84ae-5bd5e23b1017 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.294845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96d0d-a6e2-44c5-84ae-5bd5e23b1017 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.296184 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d96d0d-a6e2-44c5-84ae-5bd5e23b1017 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.297043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96d0d-a6e2-44c5-84ae-5bd5e23b1017 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:06.297549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96d0d-a6e2-44c5-84ae-5bd5e23b1017 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.299222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d96d0d-a6e2-44c5-84ae-5bd5e23b1017 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.316436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 329/660] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:06.317866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d96d0d-a6e2-44c5-84ae-5bd5e23b1017 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.353289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.353895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.378168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 332/661] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:06.378804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05450e-3285-4eab-9f6a-850a937429c1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.446860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d96d0d-a6e2-44c5-84ae-5bd5e23b1017 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.481833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1e02a-d491-4f0d-9e79-e39b3f90e6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.482447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1e02a-d491-4f0d-9e79-e39b3f90e6ad None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.482723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1e02a-d491-4f0d-9e79-e39b3f90e6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.483015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e1e02a-d491-4f0d-9e79-e39b3f90e6ad None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.483855 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1e02a-d491-4f0d-9e79-e39b3f90e6ad None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:06.484435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1e02a-d491-4f0d-9e79-e39b3f90e6ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.485685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e1e02a-d491-4f0d-9e79-e39b3f90e6ad None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.487015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd05450e-3285-4eab-9f6a-850a937429c1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.508283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 330/662] 10.222.0.59 () {56 vars in 1139 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:06.508283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1e02a-d491-4f0d-9e79-e39b3f90e6ad None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.528622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f289d271-a153-4a9e-b01c-f60c6ac2bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.529249 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289d271-a153-4a9e-b01c-f60c6ac2bb44 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.529522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289d271-a153-4a9e-b01c-f60c6ac2bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.529792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f289d271-a153-4a9e-b01c-f60c6ac2bb44 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.536676 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289d271-a153-4a9e-b01c-f60c6ac2bb44 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.538131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f289d271-a153-4a9e-b01c-f60c6ac2bb44 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f289d271-a153-4a9e-b01c-f60c6ac2bb44 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:06.549525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:06.550457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:06.551733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:06.551733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:06.551733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:06.551733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:06.551733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:06.551733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:06.551733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:06.551733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:06.551733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 333/663] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:06.552243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9fecc-41fe-453d-91cd-0a3ef56352f2 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.552243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9fecc-41fe-453d-91cd-0a3ef56352f2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.552373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9fecc-41fe-453d-91cd-0a3ef56352f2 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.553625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 334/664] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:06.554198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9fecc-41fe-453d-91cd-0a3ef56352f2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.597193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.609321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.620183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e1e02a-d491-4f0d-9e79-e39b3f90e6ad None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.655017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e7f75-b0c0-49c3-8759-90b0a85cf103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.655670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e7f75-b0c0-49c3-8759-90b0a85cf103 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.655942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e7f75-b0c0-49c3-8759-90b0a85cf103 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.656214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5e7f75-b0c0-49c3-8759-90b0a85cf103 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.666607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e7f75-b0c0-49c3-8759-90b0a85cf103 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.668188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5e7f75-b0c0-49c3-8759-90b0a85cf103 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.669908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9fecc-41fe-453d-91cd-0a3ef56352f2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-bb5e7f75-b0c0-49c3-8759-90b0a85cf103 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:06.683280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:06.684292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:06.685172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:06.685172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:06.685172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:06.685172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 331/665] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:06.685404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e7f75-b0c0-49c3-8759-90b0a85cf103 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.713377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d06efe-4de9-4554-8964-13a6962814cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.714099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d06efe-4de9-4554-8964-13a6962814cc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.714470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d06efe-4de9-4554-8964-13a6962814cc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.714744 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d06efe-4de9-4554-8964-13a6962814cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.788496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d06efe-4de9-4554-8964-13a6962814cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.790914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d06efe-4de9-4554-8964-13a6962814cc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.798436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5e7f75-b0c0-49c3-8759-90b0a85cf103 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:06.827912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.834138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e843b3-9220-44c6-a5aa-3dfcef8270cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:06.834750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e843b3-9220-44c6-a5aa-3dfcef8270cf None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.835063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e843b3-9220-44c6-a5aa-3dfcef8270cf None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.835332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e843b3-9220-44c6-a5aa-3dfcef8270cf None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.836034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e843b3-9220-44c6-a5aa-3dfcef8270cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:06.836361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e843b3-9220-44c6-a5aa-3dfcef8270cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:06.837786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e843b3-9220-44c6-a5aa-3dfcef8270cf None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:06.849862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:06.850574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 332/666] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:06.851940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb373cfd-ff5e-4f1d-98a2-3bf770315b5e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:06.852247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb373cfd-ff5e-4f1d-98a2-3bf770315b5e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:06.852431 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb373cfd-ff5e-4f1d-98a2-3bf770315b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:06.869984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-cb373cfd-ff5e-4f1d-98a2-3bf770315b5e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:06.871238 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-cb373cfd-ff5e-4f1d-98a2-3bf770315b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:06.916295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 335/667] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:06.917611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d06efe-4de9-4554-8964-13a6962814cc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:06.951176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 333/668] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:06.952150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb373cfd-ff5e-4f1d-98a2-3bf770315b5e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.029832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d06efe-4de9-4554-8964-13a6962814cc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.058100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb373cfd-ff5e-4f1d-98a2-3bf770315b5e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.067445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b3871-359b-49d8-9f7c-f4d4f4c526db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.068371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b3871-359b-49d8-9f7c-f4d4f4c526db None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.068371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b3871-359b-49d8-9f7c-f4d4f4c526db None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.068614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583b3871-359b-49d8-9f7c-f4d4f4c526db None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.069252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b3871-359b-49d8-9f7c-f4d4f4c526db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:07.069549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b3871-359b-49d8-9f7c-f4d4f4c526db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.070966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583b3871-359b-49d8-9f7c-f4d4f4c526db None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.080686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.083139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 336/669] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:07.084026 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b3871-359b-49d8-9f7c-f4d4f4c526db None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.089836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.100840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86797556-9c98-4a17-9e19-fb9dcf2b04de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.101442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86797556-9c98-4a17-9e19-fb9dcf2b04de None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.101718 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86797556-9c98-4a17-9e19-fb9dcf2b04de None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.101986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86797556-9c98-4a17-9e19-fb9dcf2b04de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.102744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86797556-9c98-4a17-9e19-fb9dcf2b04de None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=7074acac73904bab8399f223bd662863) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:07.103078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86797556-9c98-4a17-9e19-fb9dcf2b04de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.104754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86797556-9c98-4a17-9e19-fb9dcf2b04de None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.110800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 334/670] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:06 2022] GET /identity/v3/role_assignments?user.id=7074acac73904bab8399f223bd662863&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:07.111921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531292fa-a4d5-417f-bc3c-85f0caca8939 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.112197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531292fa-a4d5-417f-bc3c-85f0caca8939 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.112465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531292fa-a4d5-417f-bc3c-85f0caca8939 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.117889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 335/671] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:07.117889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531292fa-a4d5-417f-bc3c-85f0caca8939 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.236076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583b3871-359b-49d8-9f7c-f4d4f4c526db None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.238514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531292fa-a4d5-417f-bc3c-85f0caca8939 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.275373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c572a5-6bf6-4070-87cb-4eae9da51254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.276232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c572a5-6bf6-4070-87cb-4eae9da51254 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.276594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c572a5-6bf6-4070-87cb-4eae9da51254 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.276868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c572a5-6bf6-4070-87cb-4eae9da51254 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.279887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1b38e-d125-45cd-8736-d6bdda99f42d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.280532 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1b38e-d125-45cd-8736-d6bdda99f42d None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.280803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1b38e-d125-45cd-8736-d6bdda99f42d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.281078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1b38e-d125-45cd-8736-d6bdda99f42d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.288020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c572a5-6bf6-4070-87cb-4eae9da51254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.288160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1b38e-d125-45cd-8736-d6bdda99f42d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.289483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c572a5-6bf6-4070-87cb-4eae9da51254 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.289590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1b38e-d125-45cd-8736-d6bdda99f42d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-10c1b38e-d125-45cd-8736-d6bdda99f42d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:07.303591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:07.304729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:07.305692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:07.305692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:07.305692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:07.305692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:07.305692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:07.305692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:07.305692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:07.305692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:07.305692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 336/672] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:07.306250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b194e-a290-4912-a6c8-272341f6a929 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.306250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b194e-a290-4912-a6c8-272341f6a929 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.306370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617b194e-a290-4912-a6c8-272341f6a929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e1c572a5-6bf6-4070-87cb-4eae9da51254 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:07.307374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:07.308346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:07.309302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:07.309302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:07.309302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:07.312848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 337/673] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:07.313722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c572a5-6bf6-4070-87cb-4eae9da51254 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.325058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-617b194e-a290-4912-a6c8-272341f6a929 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:07.326271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-617b194e-a290-4912-a6c8-272341f6a929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:07.372482 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.381054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.410794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 337/674] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:07.410794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b194e-a290-4912-a6c8-272341f6a929 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.446309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c572a5-6bf6-4070-87cb-4eae9da51254 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.491975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1985f-41b9-4518-86ff-626a98d080e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.492713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1985f-41b9-4518-86ff-626a98d080e7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.493055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1985f-41b9-4518-86ff-626a98d080e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.493770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1985f-41b9-4518-86ff-626a98d080e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.507932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1985f-41b9-4518-86ff-626a98d080e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-09c1985f-41b9-4518-86ff-626a98d080e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:07.514156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:07.515178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:07.516068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:07.516714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 338/675] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:07.517446 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1985f-41b9-4518-86ff-626a98d080e7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.523142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617b194e-a290-4912-a6c8-272341f6a929 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.559790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffaf55-4576-4848-8925-6afe6a3c659e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.560454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffaf55-4576-4848-8925-6afe6a3c659e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.560799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffaf55-4576-4848-8925-6afe6a3c659e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.561073 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffaf55-4576-4848-8925-6afe6a3c659e None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.561867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffaf55-4576-4848-8925-6afe6a3c659e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:07.562171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffaf55-4576-4848-8925-6afe6a3c659e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.563755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ffaf55-4576-4848-8925-6afe6a3c659e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.577194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 338/676] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:07.578138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffaf55-4576-4848-8925-6afe6a3c659e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.615568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.660820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1985f-41b9-4518-86ff-626a98d080e7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.682408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.691912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffaf55-4576-4848-8925-6afe6a3c659e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.708409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f13345-dc3b-4071-a14e-b4ef9ad0eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.709023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13345-dc3b-4071-a14e-b4ef9ad0eda7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.709285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13345-dc3b-4071-a14e-b4ef9ad0eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.709552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f13345-dc3b-4071-a14e-b4ef9ad0eda7 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.710277 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f13345-dc3b-4071-a14e-b4ef9ad0eda7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:07.710564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f13345-dc3b-4071-a14e-b4ef9ad0eda7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.711988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f13345-dc3b-4071-a14e-b4ef9ad0eda7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.728431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 339/677] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:07.728431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f13345-dc3b-4071-a14e-b4ef9ad0eda7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.734228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba02e9-0f36-42a6-bba8-7cc44294a97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.734891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba02e9-0f36-42a6-bba8-7cc44294a97c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.735167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba02e9-0f36-42a6-bba8-7cc44294a97c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.735445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba02e9-0f36-42a6-bba8-7cc44294a97c None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.736117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba02e9-0f36-42a6-bba8-7cc44294a97c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:07.736420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba02e9-0f36-42a6-bba8-7cc44294a97c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.737789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba02e9-0f36-42a6-bba8-7cc44294a97c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.746723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 339/678] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:07.747549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba02e9-0f36-42a6-bba8-7cc44294a97c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.842390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f13345-dc3b-4071-a14e-b4ef9ad0eda7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.849382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:07.857035 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba02e9-0f36-42a6-bba8-7cc44294a97c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:07.888493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820946fd-c45c-4831-9bb1-fd6256af17f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.889199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820946fd-c45c-4831-9bb1-fd6256af17f0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.889384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820946fd-c45c-4831-9bb1-fd6256af17f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.889647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820946fd-c45c-4831-9bb1-fd6256af17f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.890369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820946fd-c45c-4831-9bb1-fd6256af17f0 None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=7b93049bc8aa47648d101a3f937ca8db) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:07.890726 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820946fd-c45c-4831-9bb1-fd6256af17f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:07.893170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820946fd-c45c-4831-9bb1-fd6256af17f0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:07.893627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229850f-d5cb-4724-897b-9108f03f18c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:07.894257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229850f-d5cb-4724-897b-9108f03f18c0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:07.894526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229850f-d5cb-4724-897b-9108f03f18c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:07.894799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229850f-d5cb-4724-897b-9108f03f18c0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:07.911318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 340/679] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/role_assignments?user.id=7b93049bc8aa47648d101a3f937ca8db&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:07.911318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820946fd-c45c-4831-9bb1-fd6256af17f0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.917165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229850f-d5cb-4724-897b-9108f03f18c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-d229850f-d5cb-4724-897b-9108f03f18c0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:07.922667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:07.923725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 340/680] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:07.925173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229850f-d5cb-4724-897b-9108f03f18c0 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:07.971694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.043159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820946fd-c45c-4831-9bb1-fd6256af17f0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.062289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229850f-d5cb-4724-897b-9108f03f18c0 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.086827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816210-1851-497a-aeee-4170b71fc196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.087625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816210-1851-497a-aeee-4170b71fc196 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.088001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816210-1851-497a-aeee-4170b71fc196 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.088428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf816210-1851-497a-aeee-4170b71fc196 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.097992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf816210-1851-497a-aeee-4170b71fc196 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.099805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf816210-1851-497a-aeee-4170b71fc196 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.111241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c432159-adff-496f-8b96-5f388ca930b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.111893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c432159-adff-496f-8b96-5f388ca930b8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.112149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c432159-adff-496f-8b96-5f388ca930b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.112414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c432159-adff-496f-8b96-5f388ca930b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-bf816210-1851-497a-aeee-4170b71fc196 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:08.116589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:08.117466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:08.118428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:08.118428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:08.118428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:08.118428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:08.118428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:08.118428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:08.118428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:08.118428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:08.119364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 341/681] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:08.119547 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816210-1851-497a-aeee-4170b71fc196 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.128051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c432159-adff-496f-8b96-5f388ca930b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.129662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c432159-adff-496f-8b96-5f388ca930b8 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-7c432159-adff-496f-8b96-5f388ca930b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:08.148823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:08.149969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:08.151084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:08.151084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:08.151084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:08.153438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 341/682] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:08.154529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c432159-adff-496f-8b96-5f388ca930b8 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.172566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.246552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.250492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf816210-1851-497a-aeee-4170b71fc196 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.267353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c432159-adff-496f-8b96-5f388ca930b8 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.290795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eef31-ef1c-4d1f-8146-b8da48790ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.291641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eef31-ef1c-4d1f-8146-b8da48790ab8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.292086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eef31-ef1c-4d1f-8146-b8da48790ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.292489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eef31-ef1c-4d1f-8146-b8da48790ab8 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.293424 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9eef31-ef1c-4d1f-8146-b8da48790ab8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:08.293883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9eef31-ef1c-4d1f-8146-b8da48790ab8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.295594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9eef31-ef1c-4d1f-8146-b8da48790ab8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.305387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ceb72-6df5-40f0-ad34-667308ccbffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.305701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 342/683] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:08.306703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eef31-ef1c-4d1f-8146-b8da48790ab8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.311054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ceb72-6df5-40f0-ad34-667308ccbffe None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.311054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ceb72-6df5-40f0-ad34-667308ccbffe None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.311321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816ceb72-6df5-40f0-ad34-667308ccbffe None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.312142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ceb72-6df5-40f0-ad34-667308ccbffe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:08.312549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ceb72-6df5-40f0-ad34-667308ccbffe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.314107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816ceb72-6df5-40f0-ad34-667308ccbffe None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.332902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 342/684] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:08.332902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ceb72-6df5-40f0-ad34-667308ccbffe None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.402258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.423716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eef31-ef1c-4d1f-8146-b8da48790ab8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.438469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816ceb72-6df5-40f0-ad34-667308ccbffe None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.461240 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df25bb-37fb-4947-be30-530f818ded77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.462074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df25bb-37fb-4947-be30-530f818ded77 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.462488 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df25bb-37fb-4947-be30-530f818ded77 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.463033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67df25bb-37fb-4947-be30-530f818ded77 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.464054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df25bb-37fb-4947-be30-530f818ded77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:08.464563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df25bb-37fb-4947-be30-530f818ded77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.466100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67df25bb-37fb-4947-be30-530f818ded77 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.475445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595d68b-b04c-4d30-b691-09ca1f9cde03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.476331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595d68b-b04c-4d30-b691-09ca1f9cde03 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.476675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595d68b-b04c-4d30-b691-09ca1f9cde03 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.477052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e595d68b-b04c-4d30-b691-09ca1f9cde03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.484633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 343/685] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:08.485648 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df25bb-37fb-4947-be30-530f818ded77 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.488581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595d68b-b04c-4d30-b691-09ca1f9cde03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.490487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e595d68b-b04c-4d30-b691-09ca1f9cde03 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-e595d68b-b04c-4d30-b691-09ca1f9cde03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:08.506037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:08.507227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:08.508338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:08.508338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:08.508338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:08.514348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 343/686] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:08.514996 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.516515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595d68b-b04c-4d30-b691-09ca1f9cde03 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.594575 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67df25bb-37fb-4947-be30-530f818ded77 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.630611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e595d68b-b04c-4d30-b691-09ca1f9cde03 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.632833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c905c-42b1-4c90-a89e-7e87cff59d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.634282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c905c-42b1-4c90-a89e-7e87cff59d40 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.634282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c905c-42b1-4c90-a89e-7e87cff59d40 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.634282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c905c-42b1-4c90-a89e-7e87cff59d40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.635109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c905c-42b1-4c90-a89e-7e87cff59d40 None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=309ebac21dd944029b1de80ba54dd794) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:08.635515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c905c-42b1-4c90-a89e-7e87cff59d40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.637102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c905c-42b1-4c90-a89e-7e87cff59d40 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.646960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 344/687] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/role_assignments?user.id=309ebac21dd944029b1de80ba54dd794&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:08.646960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c905c-42b1-4c90-a89e-7e87cff59d40 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.662080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.697754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d701-554f-4e1f-8d80-5df67ee32851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.698952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d701-554f-4e1f-8d80-5df67ee32851 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.699597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d701-554f-4e1f-8d80-5df67ee32851 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.700067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea7d701-554f-4e1f-8d80-5df67ee32851 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.712644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d701-554f-4e1f-8d80-5df67ee32851 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.717496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea7d701-554f-4e1f-8d80-5df67ee32851 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-cea7d701-554f-4e1f-8d80-5df67ee32851 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:08.743555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:08.744592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:08.745603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:08.745603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:08.745603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:08.745603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:08.745603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:08.745603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:08.745603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:08.745603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:08.745603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:08.745603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:08.752071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 344/688] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:08.763852 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d701-554f-4e1f-8d80-5df67ee32851 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.804098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:08.822905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c905c-42b1-4c90-a89e-7e87cff59d40 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.868200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ea06a-0e8d-4f57-9ad2-0850c3ad9e6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.869053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea06a-0e8d-4f57-9ad2-0850c3ad9e6a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.869467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea06a-0e8d-4f57-9ad2-0850c3ad9e6a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.869887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50ea06a-0e8d-4f57-9ad2-0850c3ad9e6a None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.871481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ea06a-0e8d-4f57-9ad2-0850c3ad9e6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:08.871931 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ea06a-0e8d-4f57-9ad2-0850c3ad9e6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.873477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50ea06a-0e8d-4f57-9ad2-0850c3ad9e6a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.887318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 345/689] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:08.908939 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ea06a-0e8d-4f57-9ad2-0850c3ad9e6a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:08.932767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea7d701-554f-4e1f-8d80-5df67ee32851 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:08.968732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fbf76-19e2-4c6a-9d73-79df0e7a64d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:08.969420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fbf76-19e2-4c6a-9d73-79df0e7a64d1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:08.969801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fbf76-19e2-4c6a-9d73-79df0e7a64d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:08.970173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603fbf76-19e2-4c6a-9d73-79df0e7a64d1 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:08.971048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fbf76-19e2-4c6a-9d73-79df0e7a64d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:08.971453 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fbf76-19e2-4c6a-9d73-79df0e7a64d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:08.973076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603fbf76-19e2-4c6a-9d73-79df0e7a64d1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:08.992644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 345/690] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:09.001810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fbf76-19e2-4c6a-9d73-79df0e7a64d1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:09.026180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50ea06a-0e8d-4f57-9ad2-0850c3ad9e6a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:09.046202 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:09.064082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffb838-e35d-4f7d-86a0-d822f4cae823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.065056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffb838-e35d-4f7d-86a0-d822f4cae823 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.065461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffb838-e35d-4f7d-86a0-d822f4cae823 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.065981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ffb838-e35d-4f7d-86a0-d822f4cae823 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.074266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffb838-e35d-4f7d-86a0-d822f4cae823 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.076150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ffb838-e35d-4f7d-86a0-d822f4cae823 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f1ffb838-e35d-4f7d-86a0-d822f4cae823 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:09.088831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:09.090003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:09.090955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:09.090955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:09.090955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:09.090955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:09.090955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:09.090955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:09.090955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:09.090955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:09.090955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:53:09.090955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:09.093847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 346/691] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:09.099929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffb838-e35d-4f7d-86a0-d822f4cae823 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:09.113271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:09.125039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603fbf76-19e2-4c6a-9d73-79df0e7a64d1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:09.215023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f8d96-64e5-4410-aa0e-f6f5a8c35646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.215791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f8d96-64e5-4410-aa0e-f6f5a8c35646 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.216143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f8d96-64e5-4410-aa0e-f6f5a8c35646 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.216517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6f8d96-64e5-4410-aa0e-f6f5a8c35646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.218042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ffb838-e35d-4f7d-86a0-d822f4cae823 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:09.258142 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e47b0-ffd3-43ed-9fe4-9e90e1e5526e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.259129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e47b0-ffd3-43ed-9fe4-9e90e1e5526e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.259576 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e47b0-ffd3-43ed-9fe4-9e90e1e5526e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.260028 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834e47b0-ffd3-43ed-9fe4-9e90e1e5526e None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.260970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e47b0-ffd3-43ed-9fe4-9e90e1e5526e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:09.261450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e47b0-ffd3-43ed-9fe4-9e90e1e5526e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.263752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834e47b0-ffd3-43ed-9fe4-9e90e1e5526e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.286004 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 347/692] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:09.303848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e47b0-ffd3-43ed-9fe4-9e90e1e5526e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:09.329393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f8d96-64e5-4410-aa0e-f6f5a8c35646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.331087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6f8d96-64e5-4410-aa0e-f6f5a8c35646 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.375264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:09.439177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:09.490406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 346/693] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 18 20:53:09.491558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f8d96-64e5-4410-aa0e-f6f5a8c35646 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:09.524782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834e47b0-ffd3-43ed-9fe4-9e90e1e5526e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:09.584330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6333cf-6085-487d-a928-ff4076ec68ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.584943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6333cf-6085-487d-a928-ff4076ec68ab None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.585223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6333cf-6085-487d-a928-ff4076ec68ab None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.585495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6333cf-6085-487d-a928-ff4076ec68ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.637481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6f8d96-64e5-4410-aa0e-f6f5a8c35646 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:09.673821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6333cf-6085-487d-a928-ff4076ec68ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.676273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6333cf-6085-487d-a928-ff4076ec68ab None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.680782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39747dae-e6b3-4925-b981-787c0441e1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.681560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39747dae-e6b3-4925-b981-787c0441e1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.681942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39747dae-e6b3-4925-b981-787c0441e1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.682309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39747dae-e6b3-4925-b981-787c0441e1b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.691570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:09.700886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39747dae-e6b3-4925-b981-787c0441e1b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.702379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39747dae-e6b3-4925-b981-787c0441e1b5 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-39747dae-e6b3-4925-b981-787c0441e1b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:09.722208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:09.723231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:09.724111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:09.724111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:09.724111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:09.728027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 347/694] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:09.729298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818abf4-f450-456b-aab5-6319b1f24fac None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.729708 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818abf4-f450-456b-aab5-6319b1f24fac None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.730131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b818abf4-f450-456b-aab5-6319b1f24fac None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.736143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 348/695] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:09.736143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818abf4-f450-456b-aab5-6319b1f24fac None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:09.766912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:09.826040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 348/696] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 18 20:53:09.826040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87d1e6-50f4-49b5-bab4-a5a502307f14 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.826040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87d1e6-50f4-49b5-bab4-a5a502307f14 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.826040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d87d1e6-50f4-49b5-bab4-a5a502307f14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.848591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5d87d1e6-50f4-49b5-bab4-a5a502307f14 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:09.850670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5d87d1e6-50f4-49b5-bab4-a5a502307f14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:09.856150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b818abf4-f450-456b-aab5-6319b1f24fac None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:09.892201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b36fbd-87ea-462a-a23d-28776e03e9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:09.893026 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36fbd-87ea-462a-a23d-28776e03e9e9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:09.893395 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36fbd-87ea-462a-a23d-28776e03e9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:09.893831 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b36fbd-87ea-462a-a23d-28776e03e9e9 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:09.894850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b36fbd-87ea-462a-a23d-28776e03e9e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:09.895225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b36fbd-87ea-462a-a23d-28776e03e9e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:09.897151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b36fbd-87ea-462a-a23d-28776e03e9e9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:09.921964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 349/697] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:09.921964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b36fbd-87ea-462a-a23d-28776e03e9e9 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:09.947093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 349/698] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:09.947093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87d1e6-50f4-49b5-bab4-a5a502307f14 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.004894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:10.101108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b36fbd-87ea-462a-a23d-28776e03e9e9 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.102212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:10.124047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d87d1e6-50f4-49b5-bab4-a5a502307f14 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.174466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74371a2-1b44-4798-8564-f9d2609611db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.175686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74371a2-1b44-4798-8564-f9d2609611db None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.177250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74371a2-1b44-4798-8564-f9d2609611db None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.178289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74371a2-1b44-4798-8564-f9d2609611db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.194995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecf1a5-f145-46b8-a469-92f112ce6d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.196010 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecf1a5-f145-46b8-a469-92f112ce6d02 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.196551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecf1a5-f145-46b8-a469-92f112ce6d02 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.197014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ecf1a5-f145-46b8-a469-92f112ce6d02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.201780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74371a2-1b44-4798-8564-f9d2609611db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.206845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74371a2-1b44-4798-8564-f9d2609611db None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.212829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecf1a5-f145-46b8-a469-92f112ce6d02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.215622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ecf1a5-f145-46b8-a469-92f112ce6d02 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-c74371a2-1b44-4798-8564-f9d2609611db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:10.232419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:10.233399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:10.234304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:10.234304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:10.234304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f4ecf1a5-f145-46b8-a469-92f112ce6d02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:10.240659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:10.241508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:10.242384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:10.242384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:10.242384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:10.242384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:10.242384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:10.242384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:10.242384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:10.242384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:10.244696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 350/699] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:10.250760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 350/700] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:10.251942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74371a2-1b44-4798-8564-f9d2609611db None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.253382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecf1a5-f145-46b8-a469-92f112ce6d02 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.360333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74371a2-1b44-4798-8564-f9d2609611db None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.361803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:10.380140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ecf1a5-f145-46b8-a469-92f112ce6d02 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.400365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765700b4-9a7b-4554-9ed2-e1b017cfd926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.400966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765700b4-9a7b-4554-9ed2-e1b017cfd926 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.401288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765700b4-9a7b-4554-9ed2-e1b017cfd926 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.401610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765700b4-9a7b-4554-9ed2-e1b017cfd926 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.402311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765700b4-9a7b-4554-9ed2-e1b017cfd926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:10.402609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765700b4-9a7b-4554-9ed2-e1b017cfd926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.404037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765700b4-9a7b-4554-9ed2-e1b017cfd926 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.416553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 351/701] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:10.417597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765700b4-9a7b-4554-9ed2-e1b017cfd926 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.425342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2190-3b43-4a4f-aab0-dce000d3cb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.426218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2190-3b43-4a4f-aab0-dce000d3cb97 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.426512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2190-3b43-4a4f-aab0-dce000d3cb97 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.426795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2190-3b43-4a4f-aab0-dce000d3cb97 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.427513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2190-3b43-4a4f-aab0-dce000d3cb97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:10.427813 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2190-3b43-4a4f-aab0-dce000d3cb97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.429364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2190-3b43-4a4f-aab0-dce000d3cb97 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.446839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 351/702] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:10.446839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a48da-7a11-48ae-b9d7-a6176bcd1355 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.446839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a48da-7a11-48ae-b9d7-a6176bcd1355 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.446839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5a48da-7a11-48ae-b9d7-a6176bcd1355 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.446839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 352/703] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:10.446839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a48da-7a11-48ae-b9d7-a6176bcd1355 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.463905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:10.541292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765700b4-9a7b-4554-9ed2-e1b017cfd926 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.565256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5a48da-7a11-48ae-b9d7-a6176bcd1355 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.580108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea709c-b337-4d48-a329-09586a5e0509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.580744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea709c-b337-4d48-a329-09586a5e0509 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.581016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea709c-b337-4d48-a329-09586a5e0509 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.581286 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ea709c-b337-4d48-a329-09586a5e0509 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.591814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea709c-b337-4d48-a329-09586a5e0509 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.593255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ea709c-b337-4d48-a329-09586a5e0509 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.602592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48dcfaef-1bd5-4547-b997-14622d0ab4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.603253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcfaef-1bd5-4547-b997-14622d0ab4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.603527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcfaef-1bd5-4547-b997-14622d0ab4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.603798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48dcfaef-1bd5-4547-b997-14622d0ab4a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-94ea709c-b337-4d48-a329-09586a5e0509 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:10.607976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:10.609098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:10.615796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:10.615796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:10.615796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:10.615796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 352/704] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:10.615796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea709c-b337-4d48-a329-09586a5e0509 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.617908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcfaef-1bd5-4547-b997-14622d0ab4a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.619536 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48dcfaef-1bd5-4547-b997-14622d0ab4a1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.630054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-48dcfaef-1bd5-4547-b997-14622d0ab4a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:10.631823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:10.632748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:10.633658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:10.633658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:10.633658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:10.633658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:10.633658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:10.633658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:10.633658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:10.633658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:10.633658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 353/705] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:10.634140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52bfad-0005-4591-813e-cdb1e0fb3bc4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.634825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52bfad-0005-4591-813e-cdb1e0fb3bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.634825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b52bfad-0005-4591-813e-cdb1e0fb3bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.656315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6b52bfad-0005-4591-813e-cdb1e0fb3bc4 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:10.656873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6b52bfad-0005-4591-813e-cdb1e0fb3bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:10.721720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ea709c-b337-4d48-a329-09586a5e0509 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.725599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 354/706] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:10.736297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52bfad-0005-4591-813e-cdb1e0fb3bc4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.740860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:10.757669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff308a-9843-486c-82c0-3cb9517bd7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.758558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff308a-9843-486c-82c0-3cb9517bd7ca None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.758687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff308a-9843-486c-82c0-3cb9517bd7ca None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.758992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ff308a-9843-486c-82c0-3cb9517bd7ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.759724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff308a-9843-486c-82c0-3cb9517bd7ca None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=c6ceb08f9eda4942a510bfaa0f0ef84e) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:10.760028 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff308a-9843-486c-82c0-3cb9517bd7ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.761657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ff308a-9843-486c-82c0-3cb9517bd7ca None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.768337 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 353/707] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/role_assignments?user.id=c6ceb08f9eda4942a510bfaa0f0ef84e&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=85a146946817410b9a3addcf041c5909 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:10.769269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff308a-9843-486c-82c0-3cb9517bd7ca None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.862194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:10.879441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b52bfad-0005-4591-813e-cdb1e0fb3bc4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.886720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ff308a-9843-486c-82c0-3cb9517bd7ca None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:10.922377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c895d4-33d7-4a5b-8e22-830938bba7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.923193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c895d4-33d7-4a5b-8e22-830938bba7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.923574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c895d4-33d7-4a5b-8e22-830938bba7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.923939 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c895d4-33d7-4a5b-8e22-830938bba7b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.924736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c895d4-33d7-4a5b-8e22-830938bba7b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:10.925137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c895d4-33d7-4a5b-8e22-830938bba7b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.926656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c895d4-33d7-4a5b-8e22-830938bba7b7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.932224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f6884b-1e5d-497c-9435-169a174e9455 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:10.933192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6884b-1e5d-497c-9435-169a174e9455 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.933725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6884b-1e5d-497c-9435-169a174e9455 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.934175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f6884b-1e5d-497c-9435-169a174e9455 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.935849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6884b-1e5d-497c-9435-169a174e9455 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:10.936318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6884b-1e5d-497c-9435-169a174e9455 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:10.938491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f6884b-1e5d-497c-9435-169a174e9455 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:10.941447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 355/708] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:10.946146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd854f-fde9-43d2-8cb0-44d2690177f0 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.946146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd854f-fde9-43d2-8cb0-44d2690177f0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.946146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cd854f-fde9-43d2-8cb0-44d2690177f0 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.946146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 356/709] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:10.947556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd854f-fde9-43d2-8cb0-44d2690177f0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:10.961823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 354/710] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:10.963356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4def7b4-5556-4ba5-b694-ac2729c4c9af None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:10.963635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4def7b4-5556-4ba5-b694-ac2729c4c9af None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:10.963978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4def7b4-5556-4ba5-b694-ac2729c4c9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:10.984802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-a4def7b4-5556-4ba5-b694-ac2729c4c9af None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:10.986445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a4def7b4-5556-4ba5-b694-ac2729c4c9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:11.024987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:11.069787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cd854f-fde9-43d2-8cb0-44d2690177f0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.075268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 355/711] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:11.076821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4def7b4-5556-4ba5-b694-ac2729c4c9af None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.104217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd61d7-db23-4e8e-a921-028ea1b1f1cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.104952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd61d7-db23-4e8e-a921-028ea1b1f1cf None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.105229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd61d7-db23-4e8e-a921-028ea1b1f1cf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.105499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cd61d7-db23-4e8e-a921-028ea1b1f1cf None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.106351 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd61d7-db23-4e8e-a921-028ea1b1f1cf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.107846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cd61d7-db23-4e8e-a921-028ea1b1f1cf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.138355 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 357/712] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:53:10 2022] POST /identity/v3/users => generated 254 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:11.139743 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd61d7-db23-4e8e-a921-028ea1b1f1cf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.157117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:11.222860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4def7b4-5556-4ba5-b694-ac2729c4c9af None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.279849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e22790-bba5-4f19-9407-8baf32a9532c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.280475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e22790-bba5-4f19-9407-8baf32a9532c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.280755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e22790-bba5-4f19-9407-8baf32a9532c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.281025 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e22790-bba5-4f19-9407-8baf32a9532c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.281772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e22790-bba5-4f19-9407-8baf32a9532c None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=410e8bceb7664e1d9968f85f41cc0828) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:11.282076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e22790-bba5-4f19-9407-8baf32a9532c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.291828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e22790-bba5-4f19-9407-8baf32a9532c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.298914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 356/713] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/role_assignments?user.id=410e8bceb7664e1d9968f85f41cc0828&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:11.337194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cd61d7-db23-4e8e-a921-028ea1b1f1cf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.363888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:11.380077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f22336-afc8-4716-9ad8-b0224d4fc208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.380734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f22336-afc8-4716-9ad8-b0224d4fc208 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.381027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f22336-afc8-4716-9ad8-b0224d4fc208 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.381281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f22336-afc8-4716-9ad8-b0224d4fc208 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.381885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f22336-afc8-4716-9ad8-b0224d4fc208 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.383460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f22336-afc8-4716-9ad8-b0224d4fc208 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b7f22336-afc8-4716-9ad8-b0224d4fc208 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:11.396447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:11.397850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:53:11.398670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:11.401466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 358/714] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:11.401565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e22790-bba5-4f19-9407-8baf32a9532c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.405812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f22336-afc8-4716-9ad8-b0224d4fc208 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.531126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f22336-afc8-4716-9ad8-b0224d4fc208 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.547995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e22790-bba5-4f19-9407-8baf32a9532c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.582192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9109ebf-84d0-4e89-ac9b-08c4d631bbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.582833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9109ebf-84d0-4e89-ac9b-08c4d631bbb1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.583116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9109ebf-84d0-4e89-ac9b-08c4d631bbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.583389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9109ebf-84d0-4e89-ac9b-08c4d631bbb1 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.584033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9109ebf-84d0-4e89-ac9b-08c4d631bbb1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:11.584337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9109ebf-84d0-4e89-ac9b-08c4d631bbb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.585748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9109ebf-84d0-4e89-ac9b-08c4d631bbb1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.587233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:11.592963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 359/715] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:11.598683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718637f-428e-424d-9652-3bcf3a633c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.601246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718637f-428e-424d-9652-3bcf3a633c8b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.601246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718637f-428e-424d-9652-3bcf3a633c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.601246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718637f-428e-424d-9652-3bcf3a633c8b None admin] PATH_INFO: `/v3/services/network` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.601246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718637f-428e-424d-9652-3bcf3a633c8b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.601851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718637f-428e-424d-9652-3bcf3a633c8b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.603160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9109ebf-84d0-4e89-ac9b-08c4d631bbb1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-7718637f-428e-424d-9652-3bcf3a633c8b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:11.619106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:11.620280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:53:11.621553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:11.624424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 357/716] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/services/network => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:11.630248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718637f-428e-424d-9652-3bcf3a633c8b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.672443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:11.745559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9109ebf-84d0-4e89-ac9b-08c4d631bbb1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.766723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718637f-428e-424d-9652-3bcf3a633c8b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:11.802760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e250d44-a918-42e3-80d2-b7ea318cc34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.803637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250d44-a918-42e3-80d2-b7ea318cc34c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.804090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250d44-a918-42e3-80d2-b7ea318cc34c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.804480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e250d44-a918-42e3-80d2-b7ea318cc34c None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.805231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e250d44-a918-42e3-80d2-b7ea318cc34c None admin] RBAC: Adding query filter params (name=network) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:11.805694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e250d44-a918-42e3-80d2-b7ea318cc34c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.807710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e250d44-a918-42e3-80d2-b7ea318cc34c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.812785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 358/717] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:11.818056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e250d44-a918-42e3-80d2-b7ea318cc34c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:11.819458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858d7187-372e-4b0b-8f82-2518e66f8b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:11.820084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d7187-372e-4b0b-8f82-2518e66f8b42 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:11.820361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d7187-372e-4b0b-8f82-2518e66f8b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:11.820628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858d7187-372e-4b0b-8f82-2518e66f8b42 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:11.821272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d7187-372e-4b0b-8f82-2518e66f8b42 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:11.821574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d7187-372e-4b0b-8f82-2518e66f8b42 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:11.822994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858d7187-372e-4b0b-8f82-2518e66f8b42 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:11.839198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 360/718] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:11.883246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:11.952523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e250d44-a918-42e3-80d2-b7ea318cc34c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:12.001198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4521d1-01bd-4c8f-ac16-8d1753123f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:12.002195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4521d1-01bd-4c8f-ac16-8d1753123f53 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.002866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4521d1-01bd-4c8f-ac16-8d1753123f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.003468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4521d1-01bd-4c8f-ac16-8d1753123f53 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.004234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4521d1-01bd-4c8f-ac16-8d1753123f53 None admin] RBAC: Adding query filter params (type=network) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:12.010994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4521d1-01bd-4c8f-ac16-8d1753123f53 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:12.012854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4521d1-01bd-4c8f-ac16-8d1753123f53 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:12.026010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 359/719] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:11 2022] GET /identity/v3/services?type=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:12.993172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a81b0-623f-47d2-8461-f5d1ffd0dd7b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:12.994225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a81b0-623f-47d2-8461-f5d1ffd0dd7b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:12.994708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13a81b0-623f-47d2-8461-f5d1ffd0dd7b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:12.996925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 361/720] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:13.002333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06483a82-ee1e-43cc-95b3-e97ba780f3e8 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:13.003193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06483a82-ee1e-43cc-95b3-e97ba780f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:13.003685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06483a82-ee1e-43cc-95b3-e97ba780f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:13.022682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-06483a82-ee1e-43cc-95b3-e97ba780f3e8 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:13.024280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-06483a82-ee1e-43cc-95b3-e97ba780f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:13.112648 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 360/721] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:13.505522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a81b0-623f-47d2-8461-f5d1ffd0dd7b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:13.643490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13a81b0-623f-47d2-8461-f5d1ffd0dd7b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:13.653437 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850adea-91d6-4f14-bdd9-4931a1333b35 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:13.653731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850adea-91d6-4f14-bdd9-4931a1333b35 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:13.653992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d850adea-91d6-4f14-bdd9-4931a1333b35 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:13.656604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 361/722] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:13.660776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f74f3-f7ae-4ff3-8bb1-095d26d04034 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:13.661058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f74f3-f7ae-4ff3-8bb1-095d26d04034 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:13.661325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576f74f3-f7ae-4ff3-8bb1-095d26d04034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:13.665272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:13.682008 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-576f74f3-f7ae-4ff3-8bb1-095d26d04034 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:13.690830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-576f74f3-f7ae-4ff3-8bb1-095d26d04034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:13.698820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063346-ccff-4376-b9eb-c20c98e742fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:13.699718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063346-ccff-4376-b9eb-c20c98e742fa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:13.700140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063346-ccff-4376-b9eb-c20c98e742fa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:13.700567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063346-ccff-4376-b9eb-c20c98e742fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:13.719655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba063346-ccff-4376-b9eb-c20c98e742fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ba063346-ccff-4376-b9eb-c20c98e742fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:13.726020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:13.727161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:13.728215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:13.735467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 362/723] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:13.740468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063346-ccff-4376-b9eb-c20c98e742fa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:13.798367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:13.819747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 362/724] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 18 20:53:13.923214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063346-ccff-4376-b9eb-c20c98e742fa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:13.965538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acebd6-a85a-4f3c-ad42-9d70de6b39d9 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:13.965884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acebd6-a85a-4f3c-ad42-9d70de6b39d9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:13.966089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63acebd6-a85a-4f3c-ad42-9d70de6b39d9 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:13.967652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e25536-5260-4da8-8474-855b3e6f7f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:13.967782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 363/725] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:13.968318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25536-5260-4da8-8474-855b3e6f7f71 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:13.968719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25536-5260-4da8-8474-855b3e6f7f71 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:13.968989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e25536-5260-4da8-8474-855b3e6f7f71 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:13.969661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e25536-5260-4da8-8474-855b3e6f7f71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:13.969962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e25536-5260-4da8-8474-855b3e6f7f71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:13.971535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e25536-5260-4da8-8474-855b3e6f7f71 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:13.972269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d65c0-61cf-44c4-bce0-cd13bcbf10e7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:13.972554 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d65c0-61cf-44c4-bce0-cd13bcbf10e7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:13.973137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571d65c0-61cf-44c4-bce0-cd13bcbf10e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:13.981205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 363/726] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:13.987766 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e25536-5260-4da8-8474-855b3e6f7f71 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.005354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-571d65c0-61cf-44c4-bce0-cd13bcbf10e7 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:14.006842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-571d65c0-61cf-44c4-bce0-cd13bcbf10e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:14.051231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:14.165035 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 364/727] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:14.175787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e25536-5260-4da8-8474-855b3e6f7f71 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:14.197163 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245218-4ddf-44ba-8bf5-d97923e719ba None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.197671 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245218-4ddf-44ba-8bf5-d97923e719ba None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.198117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6245218-4ddf-44ba-8bf5-d97923e719ba None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.200846 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 365/728] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:14.207279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c988-895a-47b4-8a68-6f88f038e1ac None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.207558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c988-895a-47b4-8a68-6f88f038e1ac None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.207830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c988-895a-47b4-8a68-6f88f038e1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.223497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d65d9e-5533-4ad7-9fe9-c4783061c5a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:14.224139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d65d9e-5533-4ad7-9fe9-c4783061c5a5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.224417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d65d9e-5533-4ad7-9fe9-c4783061c5a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.224688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d65d9e-5533-4ad7-9fe9-c4783061c5a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.228551 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ad62c988-895a-47b4-8a68-6f88f038e1ac None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:14.229761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ad62c988-895a-47b4-8a68-6f88f038e1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:14.235990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d65d9e-5533-4ad7-9fe9-c4783061c5a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:14.237455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d65d9e-5533-4ad7-9fe9-c4783061c5a5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-42d65d9e-5533-4ad7-9fe9-c4783061c5a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:14.252339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:14.253346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:14.254247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:14.254247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:14.254247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:14.254247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 364/729] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:14.254511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d65d9e-5533-4ad7-9fe9-c4783061c5a5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.307733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 366/730] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:14.308429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62c988-895a-47b4-8a68-6f88f038e1ac None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.362312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:14.400694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d65d9e-5533-4ad7-9fe9-c4783061c5a5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:14.404707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:14.474017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f3bef-13b1-4e9a-ae0d-b0b2cd7aa63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:14.475117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f3bef-13b1-4e9a-ae0d-b0b2cd7aa63a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.475752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f3bef-13b1-4e9a-ae0d-b0b2cd7aa63a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.477774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62c988-895a-47b4-8a68-6f88f038e1ac None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:14.478260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644f3bef-13b1-4e9a-ae0d-b0b2cd7aa63a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.500056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644f3bef-13b1-4e9a-ae0d-b0b2cd7aa63a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-644f3bef-13b1-4e9a-ae0d-b0b2cd7aa63a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:14.505248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:14.506171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:14.507039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 365/731] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:14.507732 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f3bef-13b1-4e9a-ae0d-b0b2cd7aa63a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.532166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd02188f-e79d-4db3-837d-a724f543d8a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:14.532774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02188f-e79d-4db3-837d-a724f543d8a8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.533048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02188f-e79d-4db3-837d-a724f543d8a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.533311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd02188f-e79d-4db3-837d-a724f543d8a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.533952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02188f-e79d-4db3-837d-a724f543d8a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:14.534249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02188f-e79d-4db3-837d-a724f543d8a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:14.535791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd02188f-e79d-4db3-837d-a724f543d8a8 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:14.550301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 367/732] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:14.551069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72ba6e-8895-4cfe-ab18-c2c6a5943e05 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.551472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72ba6e-8895-4cfe-ab18-c2c6a5943e05 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.551670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72ba6e-8895-4cfe-ab18-c2c6a5943e05 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.554808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 368/733] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:14.554808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72ba6e-8895-4cfe-ab18-c2c6a5943e05 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.622339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644f3bef-13b1-4e9a-ae0d-b0b2cd7aa63a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:14.656733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d029daa-a5b0-4783-87fc-c7057c152227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:14.657358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d029daa-a5b0-4783-87fc-c7057c152227 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.657635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d029daa-a5b0-4783-87fc-c7057c152227 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.657906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d029daa-a5b0-4783-87fc-c7057c152227 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.659086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72ba6e-8895-4cfe-ab18-c2c6a5943e05 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:14.661438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:14.668347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d029daa-a5b0-4783-87fc-c7057c152227 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5d029daa-a5b0-4783-87fc-c7057c152227 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:14.673463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:14.674460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 366/734] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:14.675731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aca81-39c1-4409-a025-bf2d495bd7c1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.676658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aca81-39c1-4409-a025-bf2d495bd7c1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.676658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603aca81-39c1-4409-a025-bf2d495bd7c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.689516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:14.695732 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-603aca81-39c1-4409-a025-bf2d495bd7c1 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:14.696922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-603aca81-39c1-4409-a025-bf2d495bd7c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:14.702135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7cd78-abf2-44fc-a2e5-40369ce22d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:14.702751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7cd78-abf2-44fc-a2e5-40369ce22d1d None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.703056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7cd78-abf2-44fc-a2e5-40369ce22d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.703329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a7cd78-abf2-44fc-a2e5-40369ce22d1d None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.703993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7cd78-abf2-44fc-a2e5-40369ce22d1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:14.704291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7cd78-abf2-44fc-a2e5-40369ce22d1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:14.705659 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a7cd78-abf2-44fc-a2e5-40369ce22d1d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:14.714428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 369/735] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:14.715257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7cd78-abf2-44fc-a2e5-40369ce22d1d None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.776112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 367/736] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 18 20:53:14.776907 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aca81-39c1-4409-a025-bf2d495bd7c1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.817941 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a7cd78-abf2-44fc-a2e5-40369ce22d1d None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:14.852065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7fbd-d1e0-486c-b5d8-c0af3dc5f60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:14.852724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7fbd-d1e0-486c-b5d8-c0af3dc5f60f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.852956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7fbd-d1e0-486c-b5d8-c0af3dc5f60f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.853224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a7fbd-d1e0-486c-b5d8-c0af3dc5f60f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.861006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a7fbd-d1e0-486c-b5d8-c0af3dc5f60f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:14.862459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a7fbd-d1e0-486c-b5d8-c0af3dc5f60f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-bd2a7fbd-d1e0-486c-b5d8-c0af3dc5f60f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:14.873499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:14.874494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 370/737] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Aug 18 20:53:14 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:14.875455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7fbd-d1e0-486c-b5d8-c0af3dc5f60f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.896177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603aca81-39c1-4409-a025-bf2d495bd7c1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:14.903565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:14.930927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb681a8-93a7-410f-ba5f-a58f02fd38b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:14.931537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb681a8-93a7-410f-ba5f-a58f02fd38b8 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:14.931816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb681a8-93a7-410f-ba5f-a58f02fd38b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:14.932089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb681a8-93a7-410f-ba5f-a58f02fd38b8 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:14.932791 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb681a8-93a7-410f-ba5f-a58f02fd38b8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:14.934367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb681a8-93a7-410f-ba5f-a58f02fd38b8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:14.939636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:14.952864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 368/738] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:53:14 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:14.953938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb681a8-93a7-410f-ba5f-a58f02fd38b8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:14.988457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a7fbd-d1e0-486c-b5d8-c0af3dc5f60f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.056280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367ad94-20ef-4292-b68a-a924a629915a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.056985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367ad94-20ef-4292-b68a-a924a629915a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.057463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367ad94-20ef-4292-b68a-a924a629915a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.057463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367ad94-20ef-4292-b68a-a924a629915a None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.058226 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367ad94-20ef-4292-b68a-a924a629915a None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:15.058553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367ad94-20ef-4292-b68a-a924a629915a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.060069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367ad94-20ef-4292-b68a-a924a629915a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.069109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 371/739] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:15.075026 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367ad94-20ef-4292-b68a-a924a629915a None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.084336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb681a8-93a7-410f-ba5f-a58f02fd38b8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.126207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43873b05-0907-4825-96b1-14fc0e17e7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.126757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43873b05-0907-4825-96b1-14fc0e17e7cc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.127270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43873b05-0907-4825-96b1-14fc0e17e7cc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.127620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43873b05-0907-4825-96b1-14fc0e17e7cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.140788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43873b05-0907-4825-96b1-14fc0e17e7cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.142270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43873b05-0907-4825-96b1-14fc0e17e7cc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-43873b05-0907-4825-96b1-14fc0e17e7cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:15.158272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:15.159527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:15.160623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:15.160623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:15.160623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:15.162393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 369/740] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:15.164213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43873b05-0907-4825-96b1-14fc0e17e7cc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.177975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:15.195321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367ad94-20ef-4292-b68a-a924a629915a None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.219406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:15.232280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120a804-c0b7-4513-bc2e-3c3244f90ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.233033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120a804-c0b7-4513-bc2e-3c3244f90ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.233406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120a804-c0b7-4513-bc2e-3c3244f90ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.233794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120a804-c0b7-4513-bc2e-3c3244f90ed9 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.234630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120a804-c0b7-4513-bc2e-3c3244f90ed9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:15.235076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120a804-c0b7-4513-bc2e-3c3244f90ed9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.236604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6120a804-c0b7-4513-bc2e-3c3244f90ed9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.259836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 372/741] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:15.259836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120a804-c0b7-4513-bc2e-3c3244f90ed9 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.281687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43873b05-0907-4825-96b1-14fc0e17e7cc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.318312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde3090-799b-4525-903e-2798d5793cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.318960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde3090-799b-4525-903e-2798d5793cd1 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.319238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde3090-799b-4525-903e-2798d5793cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.319508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbde3090-799b-4525-903e-2798d5793cd1 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.320163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde3090-799b-4525-903e-2798d5793cd1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.321564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbde3090-799b-4525-903e-2798d5793cd1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.337814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 370/742] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:53:15 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:15.340522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde3090-799b-4525-903e-2798d5793cd1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.372289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6120a804-c0b7-4513-bc2e-3c3244f90ed9 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.432386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90b50-f3dc-4108-81a8-e991f2413f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.433173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90b50-f3dc-4108-81a8-e991f2413f04 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.433526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90b50-f3dc-4108-81a8-e991f2413f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.434148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a90b50-f3dc-4108-81a8-e991f2413f04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.448127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:15.455330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a90b50-f3dc-4108-81a8-e991f2413f04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.457427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a90b50-f3dc-4108-81a8-e991f2413f04 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-d8a90b50-f3dc-4108-81a8-e991f2413f04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:15.477172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:15.478359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:15.479573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:15.479573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:15.479573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:15.485158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 373/743] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:15.486429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90b50-f3dc-4108-81a8-e991f2413f04 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.488918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbde3090-799b-4525-903e-2798d5793cd1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.500131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:15.536978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670db310-a5b7-4037-a7c3-bc16242f41f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.537594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670db310-a5b7-4037-a7c3-bc16242f41f2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.537871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670db310-a5b7-4037-a7c3-bc16242f41f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.538140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670db310-a5b7-4037-a7c3-bc16242f41f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.538817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670db310-a5b7-4037-a7c3-bc16242f41f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:15.539128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670db310-a5b7-4037-a7c3-bc16242f41f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.541092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670db310-a5b7-4037-a7c3-bc16242f41f2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.560643 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 371/744] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:15.560643 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670db310-a5b7-4037-a7c3-bc16242f41f2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.612616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a90b50-f3dc-4108-81a8-e991f2413f04 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.657750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7ec38-8be7-4311-bea0-c39470f9e7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.658986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7ec38-8be7-4311-bea0-c39470f9e7c6 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.659615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7ec38-8be7-4311-bea0-c39470f9e7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.660027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f7ec38-8be7-4311-bea0-c39470f9e7c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.664128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670db310-a5b7-4037-a7c3-bc16242f41f2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.673423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7ec38-8be7-4311-bea0-c39470f9e7c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.675539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f7ec38-8be7-4311-bea0-c39470f9e7c6 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-62f7ec38-8be7-4311-bea0-c39470f9e7c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:15.695135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:15.696261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:15.697429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:15.697429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:15.697429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:15.698959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 374/745] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:15.699973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7ec38-8be7-4311-bea0-c39470f9e7c6 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.709137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1ffca-58bd-4133-9998-b1d92fcfbf6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.709748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ffca-58bd-4133-9998-b1d92fcfbf6e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.710021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ffca-58bd-4133-9998-b1d92fcfbf6e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.710288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1ffca-58bd-4133-9998-b1d92fcfbf6e None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.710980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1ffca-58bd-4133-9998-b1d92fcfbf6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:15.711282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1ffca-58bd-4133-9998-b1d92fcfbf6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.712723 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1ffca-58bd-4133-9998-b1d92fcfbf6e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.729512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 372/746] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:15.730458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1ffca-58bd-4133-9998-b1d92fcfbf6e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.757513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:15.769318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:15.835623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f7ec38-8be7-4311-bea0-c39470f9e7c6 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.851989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1ffca-58bd-4133-9998-b1d92fcfbf6e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:15.874884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd171c-f33e-447a-9c4e-7c0c65a1139c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.875798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd171c-f33e-447a-9c4e-7c0c65a1139c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.876801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd171c-f33e-447a-9c4e-7c0c65a1139c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.877219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd171c-f33e-447a-9c4e-7c0c65a1139c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.888711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd171c-f33e-447a-9c4e-7c0c65a1139c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.890394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cd171c-f33e-447a-9c4e-7c0c65a1139c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.891543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f3550-65f9-4507-8f3a-7e4d9b845249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:15.892146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f3550-65f9-4507-8f3a-7e4d9b845249 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:15.892425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f3550-65f9-4507-8f3a-7e4d9b845249 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:15.892691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08f3550-65f9-4507-8f3a-7e4d9b845249 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:15.893497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f3550-65f9-4507-8f3a-7e4d9b845249 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:15.893794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f3550-65f9-4507-8f3a-7e4d9b845249 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:15.896001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08f3550-65f9-4507-8f3a-7e4d9b845249 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-f8cd171c-f33e-447a-9c4e-7c0c65a1139c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:15.905237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:15.906409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:15.907489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:15.907489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:15.907489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:15.907489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:15.907489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:15.907489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:15.907489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:15.907489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:15.907489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:53:15.907489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:15.908697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 375/747] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:15.909129 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd171c-f33e-447a-9c4e-7c0c65a1139c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:15.917043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 373/748] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:15.917043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f3550-65f9-4507-8f3a-7e4d9b845249 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.022682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.038534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08f3550-65f9-4507-8f3a-7e4d9b845249 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.045243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd171c-f33e-447a-9c4e-7c0c65a1139c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.047520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.086418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c79806-72fc-428a-a681-756d90b4d5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.087868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c79806-72fc-428a-a681-756d90b4d5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.088445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c79806-72fc-428a-a681-756d90b4d5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.089095 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c79806-72fc-428a-a681-756d90b4d5f8 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.090025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c79806-72fc-428a-a681-756d90b4d5f8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:16.090553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c79806-72fc-428a-a681-756d90b4d5f8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.092370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c79806-72fc-428a-a681-756d90b4d5f8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.097967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6456011-6be6-47e2-a844-d904af68de37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.098618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6456011-6be6-47e2-a844-d904af68de37 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.098932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6456011-6be6-47e2-a844-d904af68de37 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.099203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6456011-6be6-47e2-a844-d904af68de37 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.108609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6456011-6be6-47e2-a844-d904af68de37 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.110663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6456011-6be6-47e2-a844-d904af68de37 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.113505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 374/749] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:16.114587 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c79806-72fc-428a-a681-756d90b4d5f8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-d6456011-6be6-47e2-a844-d904af68de37 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:16.129977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:16.132247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:16.133234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:16.133234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:16.133234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:16.133234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:16.133234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:16.133234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:16.133234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:16.133234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:16.133234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:16.133234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:16.134920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 376/750] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Aug 18 20:53:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:16.136063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6456011-6be6-47e2-a844-d904af68de37 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.237298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c79806-72fc-428a-a681-756d90b4d5f8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.267140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6456011-6be6-47e2-a844-d904af68de37 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.276395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d75da7-3855-4d1b-9fa5-6ae5c1ec3caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.277141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d75da7-3855-4d1b-9fa5-6ae5c1ec3caf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.277421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d75da7-3855-4d1b-9fa5-6ae5c1ec3caf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.277692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d75da7-3855-4d1b-9fa5-6ae5c1ec3caf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.286974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d75da7-3855-4d1b-9fa5-6ae5c1ec3caf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.288451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d75da7-3855-4d1b-9fa5-6ae5c1ec3caf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-01d75da7-3855-4d1b-9fa5-6ae5c1ec3caf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:16.303478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:16.304393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:16.305290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:16.305290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:16.305290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:16.305290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:16.305290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:16.305290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:16.305290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:16.305290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:16.306903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 375/751] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:16.308024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d75da7-3855-4d1b-9fa5-6ae5c1ec3caf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.309804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1cd60-80f4-4ea9-adcf-059c6e2ec9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.310691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1cd60-80f4-4ea9-adcf-059c6e2ec9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.311217 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1cd60-80f4-4ea9-adcf-059c6e2ec9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.311678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd1cd60-80f4-4ea9-adcf-059c6e2ec9b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.319415 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.345812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.389359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1cd60-80f4-4ea9-adcf-059c6e2ec9b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.391396 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd1cd60-80f4-4ea9-adcf-059c6e2ec9b6 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.435690 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d75da7-3855-4d1b-9fa5-6ae5c1ec3caf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.479171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f35116-aa99-4e3a-b852-47be8b039d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.479820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f35116-aa99-4e3a-b852-47be8b039d90 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.480102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f35116-aa99-4e3a-b852-47be8b039d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.480376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f35116-aa99-4e3a-b852-47be8b039d90 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.481119 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f35116-aa99-4e3a-b852-47be8b039d90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:16.481432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f35116-aa99-4e3a-b852-47be8b039d90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.482920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f35116-aa99-4e3a-b852-47be8b039d90 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.510910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 377/752] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:53:16.512229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1cd60-80f4-4ea9-adcf-059c6e2ec9b6 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.512423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 376/753] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Aug 18 20:53:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:16.516247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f35116-aa99-4e3a-b852-47be8b039d90 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.587717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.589631 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.635245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f35116-aa99-4e3a-b852-47be8b039d90 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.640234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd1cd60-80f4-4ea9-adcf-059c6e2ec9b6 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.670796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe7d91-9881-4ab1-b46f-86f36e9b4a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.671393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe7d91-9881-4ab1-b46f-86f36e9b4a1d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.671677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe7d91-9881-4ab1-b46f-86f36e9b4a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.671951 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe7d91-9881-4ab1-b46f-86f36e9b4a1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.686178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8900f-1b25-4caa-a293-b58a6bee419b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.687241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8900f-1b25-4caa-a293-b58a6bee419b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.687980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8900f-1b25-4caa-a293-b58a6bee419b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.688451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d8900f-1b25-4caa-a293-b58a6bee419b None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.689924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8900f-1b25-4caa-a293-b58a6bee419b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:16.690529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8900f-1b25-4caa-a293-b58a6bee419b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.692865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d8900f-1b25-4caa-a293-b58a6bee419b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.710985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 378/754] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:16.712132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8900f-1b25-4caa-a293-b58a6bee419b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.760425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe7d91-9881-4ab1-b46f-86f36e9b4a1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:16.762986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe7d91-9881-4ab1-b46f-86f36e9b4a1d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:16.836436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.885295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 377/755] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:53:16.885295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe7d91-9881-4ab1-b46f-86f36e9b4a1d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:16.947832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d8900f-1b25-4caa-a293-b58a6bee419b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.973169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:16.985692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95c89f-4aa6-4389-ba6c-4a108048804c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:16.986330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95c89f-4aa6-4389-ba6c-4a108048804c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:16.986610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95c89f-4aa6-4389-ba6c-4a108048804c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:16.986908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d95c89f-4aa6-4389-ba6c-4a108048804c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:16.994516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe7d91-9881-4ab1-b46f-86f36e9b4a1d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:16.999813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95c89f-4aa6-4389-ba6c-4a108048804c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.001268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d95c89f-4aa6-4389-ba6c-4a108048804c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-7d95c89f-4aa6-4389-ba6c-4a108048804c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:17.016038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:17.022018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:17.023136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:17.023136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:17.023136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:17.023136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 379/756] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:17.023136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95c89f-4aa6-4389-ba6c-4a108048804c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.042417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471770c5-2a61-4958-bd03-cff365c68a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.043103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471770c5-2a61-4958-bd03-cff365c68a71 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.043378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471770c5-2a61-4958-bd03-cff365c68a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.043648 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471770c5-2a61-4958-bd03-cff365c68a71 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/c6ceb08f9eda4942a510bfaa0f0ef84e/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.045985 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471770c5-2a61-4958-bd03-cff365c68a71 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=c6ceb08f9eda4942a510bfaa0f0ef84e, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.047495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471770c5-2a61-4958-bd03-cff365c68a71 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.066968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 378/757] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:16 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/c6ceb08f9eda4942a510bfaa0f0ef84e/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:17.066968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741277b-d42a-4e84-8664-14588b369d4a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.066968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741277b-d42a-4e84-8664-14588b369d4a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.066968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2741277b-d42a-4e84-8664-14588b369d4a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.066968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 379/758] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:17.066968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741277b-d42a-4e84-8664-14588b369d4a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.102164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.167301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d95c89f-4aa6-4389-ba6c-4a108048804c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.195539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2741277b-d42a-4e84-8664-14588b369d4a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.215397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443d2115-990c-4adf-8cc5-2e7151dc6f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.216314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d2115-990c-4adf-8cc5-2e7151dc6f5a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.216588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d2115-990c-4adf-8cc5-2e7151dc6f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.217474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443d2115-990c-4adf-8cc5-2e7151dc6f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.232076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d2115-990c-4adf-8cc5-2e7151dc6f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.233549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443d2115-990c-4adf-8cc5-2e7151dc6f5a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.241427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b79d9-f85d-4747-aa89-5c849be4dd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.242295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b79d9-f85d-4747-aa89-5c849be4dd0c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.243171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b79d9-f85d-4747-aa89-5c849be4dd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.243594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357b79d9-f85d-4747-aa89-5c849be4dd0c None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.244747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b79d9-f85d-4747-aa89-5c849be4dd0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:17.245252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b79d9-f85d-4747-aa89-5c849be4dd0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.246951 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357b79d9-f85d-4747-aa89-5c849be4dd0c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-443d2115-990c-4adf-8cc5-2e7151dc6f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:17.249027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:17.250153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:17.251266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:17.251266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:17.251266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:17.251266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 380/759] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:17.253358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e0ff7-a2d8-4962-95f3-df2178d6cda8 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.253735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e0ff7-a2d8-4962-95f3-df2178d6cda8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.254099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e0ff7-a2d8-4962-95f3-df2178d6cda8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.264712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 380/760] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:17.265874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b79d9-f85d-4747-aa89-5c849be4dd0c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.280006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-df7e0ff7-a2d8-4962-95f3-df2178d6cda8 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:17.281736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-df7e0ff7-a2d8-4962-95f3-df2178d6cda8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:17.309403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.364881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.371577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 381/761] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:17.371577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e0ff7-a2d8-4962-95f3-df2178d6cda8 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.389938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357b79d9-f85d-4747-aa89-5c849be4dd0c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.434716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aeec0b-9478-4c06-8e65-5aad631d71f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.435970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeec0b-9478-4c06-8e65-5aad631d71f7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.436663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeec0b-9478-4c06-8e65-5aad631d71f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.437073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aeec0b-9478-4c06-8e65-5aad631d71f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.437856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeec0b-9478-4c06-8e65-5aad631d71f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:17.438296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeec0b-9478-4c06-8e65-5aad631d71f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.440104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aeec0b-9478-4c06-8e65-5aad631d71f7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.458480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 381/762] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:17.460073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6e031-69fa-4289-86fc-b8de663cb818 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.460481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6e031-69fa-4289-86fc-b8de663cb818 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.460880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee6e031-69fa-4289-86fc-b8de663cb818 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.466474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 382/763] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:17.467669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6e031-69fa-4289-86fc-b8de663cb818 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.486115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e0ff7-a2d8-4962-95f3-df2178d6cda8 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.524642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51144b88-1b4b-4c50-9267-64244c0f2f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.525250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51144b88-1b4b-4c50-9267-64244c0f2f05 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.525616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51144b88-1b4b-4c50-9267-64244c0f2f05 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.525974 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51144b88-1b4b-4c50-9267-64244c0f2f05 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.534180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51144b88-1b4b-4c50-9267-64244c0f2f05 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.535791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51144b88-1b4b-4c50-9267-64244c0f2f05 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-51144b88-1b4b-4c50-9267-64244c0f2f05 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:17.549095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:17.550220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:17.551221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:17.551221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:17.551221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:17.551221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:17.551221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:17.551221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:17.551221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:17.551221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:17.552190 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 382/764] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:17.553735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1b3fe-d4b4-4c76-9b3e-0113115f4ed6 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.554426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1b3fe-d4b4-4c76-9b3e-0113115f4ed6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.554426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c1b3fe-d4b4-4c76-9b3e-0113115f4ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.580715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-96c1b3fe-d4b4-4c76-9b3e-0113115f4ed6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:17.581722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-96c1b3fe-d4b4-4c76-9b3e-0113115f4ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:17.594574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.598278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee6e031-69fa-4289-86fc-b8de663cb818 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.634658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb9b29-5896-4703-b84f-daaee11b1add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.635387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9b29-5896-4703-b84f-daaee11b1add None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.635952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9b29-5896-4703-b84f-daaee11b1add None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.636230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb9b29-5896-4703-b84f-daaee11b1add None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.643358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb9b29-5896-4703-b84f-daaee11b1add None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.644879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb9b29-5896-4703-b84f-daaee11b1add None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-aadb9b29-5896-4703-b84f-daaee11b1add None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:17.657076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:17.657987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:17.658900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:17.658900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:17.658900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:17.658900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:17.658900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:17.658900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:17.658900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:17.658900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:17.658900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 383/765] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:17.659463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb9b29-5896-4703-b84f-daaee11b1add None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.663355 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.670856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 383/766] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:17.670856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1b3fe-d4b4-4c76-9b3e-0113115f4ed6 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.781410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb9b29-5896-4703-b84f-daaee11b1add None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.792270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c1b3fe-d4b4-4c76-9b3e-0113115f4ed6 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.818325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd76770-7699-4e59-888a-2d54a03f4991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.819346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd76770-7699-4e59-888a-2d54a03f4991 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.819609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd76770-7699-4e59-888a-2d54a03f4991 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.820000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd76770-7699-4e59-888a-2d54a03f4991 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.820786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd76770-7699-4e59-888a-2d54a03f4991 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:17.821181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd76770-7699-4e59-888a-2d54a03f4991 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.822947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd76770-7699-4e59-888a-2d54a03f4991 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.827716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27421d5-1aef-46c0-861d-b337ea07a87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.828525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27421d5-1aef-46c0-861d-b337ea07a87e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.828933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27421d5-1aef-46c0-861d-b337ea07a87e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.829333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a27421d5-1aef-46c0-861d-b337ea07a87e None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.830070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27421d5-1aef-46c0-861d-b337ea07a87e None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.831761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a27421d5-1aef-46c0-861d-b337ea07a87e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.836750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 384/767] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:17.837768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd76770-7699-4e59-888a-2d54a03f4991 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-a27421d5-1aef-46c0-861d-b337ea07a87e None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:17.841150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:17.842116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:53:17.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:17.845715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 384/768] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:17.846798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27421d5-1aef-46c0-861d-b337ea07a87e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:17.859637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.907934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:17.949379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a27421d5-1aef-46c0-861d-b337ea07a87e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.950192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd76770-7699-4e59-888a-2d54a03f4991 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:17.984995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f797de9-9096-4eb6-8551-ed1bd65779ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.985630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f797de9-9096-4eb6-8551-ed1bd65779ac None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.985902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f797de9-9096-4eb6-8551-ed1bd65779ac None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.986165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f797de9-9096-4eb6-8551-ed1bd65779ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.986510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c28d8-69e5-448b-a6b1-65998ed42672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:17.986909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f797de9-9096-4eb6-8551-ed1bd65779ac None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=410e8bceb7664e1d9968f85f41cc0828) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:17.987209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f797de9-9096-4eb6-8551-ed1bd65779ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.987319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c28d8-69e5-448b-a6b1-65998ed42672 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:17.987474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c28d8-69e5-448b-a6b1-65998ed42672 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:17.987743 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c28d8-69e5-448b-a6b1-65998ed42672 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:17.988426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c28d8-69e5-448b-a6b1-65998ed42672 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:17.988628 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f797de9-9096-4eb6-8551-ed1bd65779ac None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.988731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c28d8-69e5-448b-a6b1-65998ed42672 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:17.990115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c28d8-69e5-448b-a6b1-65998ed42672 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:17.998902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 385/769] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/role_assignments?user.id=410e8bceb7664e1d9968f85f41cc0828&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=85a146946817410b9a3addcf041c5909 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:17.998902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f797de9-9096-4eb6-8551-ed1bd65779ac None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.003226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 385/770] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:18.004251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c28d8-69e5-448b-a6b1-65998ed42672 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.100730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.124509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c28d8-69e5-448b-a6b1-65998ed42672 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.136588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f797de9-9096-4eb6-8551-ed1bd65779ac None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.154743 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.169202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c03632-3247-45cb-ad69-9320f99ece5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.170267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c03632-3247-45cb-ad69-9320f99ece5b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.170714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c03632-3247-45cb-ad69-9320f99ece5b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.171180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c03632-3247-45cb-ad69-9320f99ece5b None admin] PATH_INFO: `/v3/services/network` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.172048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c03632-3247-45cb-ad69-9320f99ece5b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.173620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c03632-3247-45cb-ad69-9320f99ece5b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.179428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b4b8c-da28-4e51-b2c6-c525f8a964d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.180075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b4b8c-da28-4e51-b2c6-c525f8a964d4 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.180327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b4b8c-da28-4e51-b2c6-c525f8a964d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.180593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6b4b8c-da28-4e51-b2c6-c525f8a964d4 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.181235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b4b8c-da28-4e51-b2c6-c525f8a964d4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:18.181531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b4b8c-da28-4e51-b2c6-c525f8a964d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.183276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6b4b8c-da28-4e51-b2c6-c525f8a964d4 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-b7c03632-3247-45cb-ad69-9320f99ece5b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:18.185979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:18.187011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:53:18.187833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:18.189679 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 386/771] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Aug 18 20:53:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:18.190606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b4b8c-da28-4e51-b2c6-c525f8a964d4 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.191361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 386/772] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/services/network => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:18.194916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c03632-3247-45cb-ad69-9320f99ece5b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.299680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c03632-3247-45cb-ad69-9320f99ece5b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.303850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6b4b8c-da28-4e51-b2c6-c525f8a964d4 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.334801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9ab39-bd49-4ed5-90c5-61970b9fc815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.335416 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9ab39-bd49-4ed5-90c5-61970b9fc815 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.335690 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9ab39-bd49-4ed5-90c5-61970b9fc815 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.335955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab9ab39-bd49-4ed5-90c5-61970b9fc815 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.336588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9ab39-bd49-4ed5-90c5-61970b9fc815 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:18.336883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9ab39-bd49-4ed5-90c5-61970b9fc815 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.338341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab9ab39-bd49-4ed5-90c5-61970b9fc815 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.342060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09d354-6125-4882-aa7e-8eb052c55d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.342913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09d354-6125-4882-aa7e-8eb052c55d5f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.343332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09d354-6125-4882-aa7e-8eb052c55d5f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.348332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f09d354-6125-4882-aa7e-8eb052c55d5f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.348464 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 387/773] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:18.348464 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9ab39-bd49-4ed5-90c5-61970b9fc815 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.348622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09d354-6125-4882-aa7e-8eb052c55d5f None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=773fb77106de4530a089e7abca48e333) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:18.348622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09d354-6125-4882-aa7e-8eb052c55d5f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.349504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f09d354-6125-4882-aa7e-8eb052c55d5f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.357107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 387/774] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/role_assignments?user.id=773fb77106de4530a089e7abca48e333&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:18.364521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09d354-6125-4882-aa7e-8eb052c55d5f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.364521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.469898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.548118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab9ab39-bd49-4ed5-90c5-61970b9fc815 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.575136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f09d354-6125-4882-aa7e-8eb052c55d5f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f01af-5404-438a-b4b5-2129ab384420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.591757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f01af-5404-438a-b4b5-2129ab384420 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.592026 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f01af-5404-438a-b4b5-2129ab384420 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.592289 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f01af-5404-438a-b4b5-2129ab384420 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.592920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f01af-5404-438a-b4b5-2129ab384420 None admin] RBAC: Adding query filter params (name=network) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:18.593269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f01af-5404-438a-b4b5-2129ab384420 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.594873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f01af-5404-438a-b4b5-2129ab384420 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.599786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 388/775] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/services?name=network => generated 124 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:18.605566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f01af-5404-438a-b4b5-2129ab384420 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.625457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf5090-1f8a-435c-9b65-b44bba88cedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.626975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf5090-1f8a-435c-9b65-b44bba88cedd None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.627873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf5090-1f8a-435c-9b65-b44bba88cedd None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.628497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdf5090-1f8a-435c-9b65-b44bba88cedd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.629509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf5090-1f8a-435c-9b65-b44bba88cedd None admin] RBAC: Adding query filter params (interface=public, service_id=7cf94be1af5f4c28bdde6cdfd648e54f, region_id=RegionOne) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:18.629993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf5090-1f8a-435c-9b65-b44bba88cedd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.632507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdf5090-1f8a-435c-9b65-b44bba88cedd None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.641756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 388/776] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/endpoints?service_id=7cf94be1af5f4c28bdde6cdfd648e54f&interface=public®ion_id=RegionOne => generated 194 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:18.648693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf5090-1f8a-435c-9b65-b44bba88cedd None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:18.724740 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.765701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdf5090-1f8a-435c-9b65-b44bba88cedd None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.801180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f01af-5404-438a-b4b5-2129ab384420 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:18.803822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253609b2-e9e0-4d8f-8607-079d23e77e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.804765 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253609b2-e9e0-4d8f-8607-079d23e77e93 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.805237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253609b2-e9e0-4d8f-8607-079d23e77e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.805722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253609b2-e9e0-4d8f-8607-079d23e77e93 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.806685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253609b2-e9e0-4d8f-8607-079d23e77e93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.808341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253609b2-e9e0-4d8f-8607-079d23e77e93 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.814277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 389/777] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/services => generated 772 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:18.835461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:18.868385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef3e4a-2e4e-4c60-8f63-460c8b56a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:18.869016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef3e4a-2e4e-4c60-8f63-460c8b56a9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:18.869345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef3e4a-2e4e-4c60-8f63-460c8b56a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:18.869626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ef3e4a-2e4e-4c60-8f63-460c8b56a9d3 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:18.870360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef3e4a-2e4e-4c60-8f63-460c8b56a9d3 None admin] RBAC: Adding query filter params (type=network) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:18.870662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef3e4a-2e4e-4c60-8f63-460c8b56a9d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:18.872099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ef3e4a-2e4e-4c60-8f63-460c8b56a9d3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:18.878341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 389/778] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/services?type=network => generated 350 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:18.883999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253609b2-e9e0-4d8f-8607-079d23e77e93 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.028143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253609b2-e9e0-4d8f-8607-079d23e77e93 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.061085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:19.070608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26abf4b5-3f8d-4595-ab85-c06b476b7aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.071271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf4b5-3f8d-4595-ab85-c06b476b7aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.071541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf4b5-3f8d-4595-ab85-c06b476b7aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.071814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26abf4b5-3f8d-4595-ab85-c06b476b7aa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.072525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abf4b5-3f8d-4595-ab85-c06b476b7aa3 None admin] RBAC: Adding query filter params (interface=public, service_id=7d8cc84cb6ff4df2abf6d19c5c410f02, region_id=RegionOne) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:19.072831 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abf4b5-3f8d-4595-ab85-c06b476b7aa3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.074298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26abf4b5-3f8d-4595-ab85-c06b476b7aa3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.080446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 390/779] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Aug 18 20:53:18 2022] GET /identity/v3/endpoints?service_id=7d8cc84cb6ff4df2abf6d19c5c410f02&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:19.085651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef3e4a-2e4e-4c60-8f63-460c8b56a9d3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.140562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965d9db-4f58-4568-835b-799d611f2027 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.140755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965d9db-4f58-4568-835b-799d611f2027 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.141015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4965d9db-4f58-4568-835b-799d611f2027 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.142838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 391/780] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:19.148589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb79aac-b018-4945-a712-f7c176e7d19a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.148868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb79aac-b018-4945-a712-f7c176e7d19a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.149141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb79aac-b018-4945-a712-f7c176e7d19a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.169484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-deb79aac-b018-4945-a712-f7c176e7d19a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:19.170730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-deb79aac-b018-4945-a712-f7c176e7d19a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:19.210232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ef3e4a-2e4e-4c60-8f63-460c8b56a9d3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.271314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 392/781] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:19.280543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27839f14-63f2-40b1-a41a-92f48e77be8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.281158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839f14-63f2-40b1-a41a-92f48e77be8b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.281434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839f14-63f2-40b1-a41a-92f48e77be8b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.281701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27839f14-63f2-40b1-a41a-92f48e77be8b None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.282307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27839f14-63f2-40b1-a41a-92f48e77be8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.283710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27839f14-63f2-40b1-a41a-92f48e77be8b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.289256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 390/782] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/services => generated 772 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:19.559491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb79aac-b018-4945-a712-f7c176e7d19a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.673288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb79aac-b018-4945-a712-f7c176e7d19a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.710231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:19.724406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6774d-3f5a-4188-8be6-ee0392df05d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.725050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6774d-3f5a-4188-8be6-ee0392df05d5 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.725330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6774d-3f5a-4188-8be6-ee0392df05d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.725596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6774d-3f5a-4188-8be6-ee0392df05d5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.742686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb6774d-3f5a-4188-8be6-ee0392df05d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-4fb6774d-3f5a-4188-8be6-ee0392df05d5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:19.748000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:19.750105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:19.752123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 393/783] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:19.755603 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27839f14-63f2-40b1-a41a-92f48e77be8b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:19.824946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:19.880046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27839f14-63f2-40b1-a41a-92f48e77be8b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:19.914654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aec853-32b2-4d1e-8483-6a86bbcd2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:19.915291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aec853-32b2-4d1e-8483-6a86bbcd2a0d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:19.915565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aec853-32b2-4d1e-8483-6a86bbcd2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:19.915832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aec853-32b2-4d1e-8483-6a86bbcd2a0d None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:19.916500 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aec853-32b2-4d1e-8483-6a86bbcd2a0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:19.916798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aec853-32b2-4d1e-8483-6a86bbcd2a0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:19.918446 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aec853-32b2-4d1e-8483-6a86bbcd2a0d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:19.927371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 391/784] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:19.932908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6774d-3f5a-4188-8be6-ee0392df05d5 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.070885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6774d-3f5a-4188-8be6-ee0392df05d5 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.121221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405dd378-b598-4a7d-9b76-3960bc36a089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.121780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd378-b598-4a7d-9b76-3960bc36a089 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.122057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd378-b598-4a7d-9b76-3960bc36a089 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.122326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405dd378-b598-4a7d-9b76-3960bc36a089 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.133565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dd378-b598-4a7d-9b76-3960bc36a089 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.135514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405dd378-b598-4a7d-9b76-3960bc36a089 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-405dd378-b598-4a7d-9b76-3960bc36a089 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:20.158547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:20.160803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:20.162938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:20.162938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:20.162938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:20.162938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 394/785] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:20.166802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aec853-32b2-4d1e-8483-6a86bbcd2a0d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.271717 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f81e8-6dde-45c2-90a4-72f2f2fb9cc0 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.271717 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f81e8-6dde-45c2-90a4-72f2f2fb9cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.271717 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f81e8-6dde-45c2-90a4-72f2f2fb9cc0 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.271717 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 395/786] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:20.278812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e2b29-561d-41c8-b523-1cd3ac9d6a36 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.278812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e2b29-561d-41c8-b523-1cd3ac9d6a36 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.278812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718e2b29-561d-41c8-b523-1cd3ac9d6a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.296823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-718e2b29-561d-41c8-b523-1cd3ac9d6a36 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:20.298356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-718e2b29-561d-41c8-b523-1cd3ac9d6a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:20.321258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aec853-32b2-4d1e-8483-6a86bbcd2a0d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.332357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.333172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.386781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 396/787] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:20.389677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b666124-1317-4598-9fa8-6237993c9ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.390285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b666124-1317-4598-9fa8-6237993c9ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.390622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b666124-1317-4598-9fa8-6237993c9ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.390972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b666124-1317-4598-9fa8-6237993c9ee6 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.391627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b666124-1317-4598-9fa8-6237993c9ee6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:20.391975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b666124-1317-4598-9fa8-6237993c9ee6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.393365 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b666124-1317-4598-9fa8-6237993c9ee6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.414069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 392/788] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:20.419873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e2b29-561d-41c8-b523-1cd3ac9d6a36 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.554242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718e2b29-561d-41c8-b523-1cd3ac9d6a36 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.564597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002466d-f1e8-4032-8e4f-5b09e45a4219 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.564879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002466d-f1e8-4032-8e4f-5b09e45a4219 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.565153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7002466d-f1e8-4032-8e4f-5b09e45a4219 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.566628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 393/789] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:20.574586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf230d9-5768-4e1e-a8b5-680ef2dcd5da None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.574586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf230d9-5768-4e1e-a8b5-680ef2dcd5da None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.574586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf230d9-5768-4e1e-a8b5-680ef2dcd5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.619800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6018cd-936e-40d6-a1f8-1f295c8f68c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.620853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6018cd-936e-40d6-a1f8-1f295c8f68c1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.621130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6018cd-936e-40d6-a1f8-1f295c8f68c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.621399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6018cd-936e-40d6-a1f8-1f295c8f68c1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.637079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6018cd-936e-40d6-a1f8-1f295c8f68c1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.638491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6018cd-936e-40d6-a1f8-1f295c8f68c1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-6f6018cd-936e-40d6-a1f8-1f295c8f68c1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:20.661310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:20.662308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:20.663390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:20.663390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:20.663390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:20.663390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:20.663390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:20.663390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:20.663390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:20.663390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:20.663390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:20.663390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:20.676579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 397/790] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:20.677614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6018cd-936e-40d6-a1f8-1f295c8f68c1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.711151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.767423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-edf230d9-5768-4e1e-a8b5-680ef2dcd5da None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:20.768618 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-edf230d9-5768-4e1e-a8b5-680ef2dcd5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:20.812204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6018cd-936e-40d6-a1f8-1f295c8f68c1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:20.849446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54a807-5a11-416a-a1dd-46293c761da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:20.850254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a807-5a11-416a-a1dd-46293c761da8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:20.850530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a807-5a11-416a-a1dd-46293c761da8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:20.850822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de54a807-5a11-416a-a1dd-46293c761da8 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:20.851710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54a807-5a11-416a-a1dd-46293c761da8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:20.852014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54a807-5a11-416a-a1dd-46293c761da8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:20.852220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 394/791] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:20.853008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf230d9-5768-4e1e-a8b5-680ef2dcd5da None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.853576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de54a807-5a11-416a-a1dd-46293c761da8 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:20.877281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 398/792] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:20.878610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54a807-5a11-416a-a1dd-46293c761da8 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:20.970889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.977029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:20.977826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf230d9-5768-4e1e-a8b5-680ef2dcd5da None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.012866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de54a807-5a11-416a-a1dd-46293c761da8 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.039379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197343fb-d95d-401b-b13d-defa1345f323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.040007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197343fb-d95d-401b-b13d-defa1345f323 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.040279 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197343fb-d95d-401b-b13d-defa1345f323 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.040545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197343fb-d95d-401b-b13d-defa1345f323 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.052188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197343fb-d95d-401b-b13d-defa1345f323 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-197343fb-d95d-401b-b13d-defa1345f323 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:21.057089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:21.058341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:21.059628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:21.062942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 395/793] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:21.064838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197343fb-d95d-401b-b13d-defa1345f323 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.103462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a3939-a317-45f1-9f50-5e2f67882f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.104727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a3939-a317-45f1-9f50-5e2f67882f0b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.105212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a3939-a317-45f1-9f50-5e2f67882f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.105682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94a3939-a317-45f1-9f50-5e2f67882f0b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.172822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197343fb-d95d-401b-b13d-defa1345f323 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.210488 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d544aa1-9434-4148-a353-9d46411d39ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.211128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d544aa1-9434-4148-a353-9d46411d39ba None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.211399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d544aa1-9434-4148-a353-9d46411d39ba None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.211669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d544aa1-9434-4148-a353-9d46411d39ba None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.212431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d544aa1-9434-4148-a353-9d46411d39ba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:21.212732 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d544aa1-9434-4148-a353-9d46411d39ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.214487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d544aa1-9434-4148-a353-9d46411d39ba None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.215636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a3939-a317-45f1-9f50-5e2f67882f0b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.217084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94a3939-a317-45f1-9f50-5e2f67882f0b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.228455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 396/794] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:21.229452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d544aa1-9434-4148-a353-9d46411d39ba None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.251276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.303371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.325867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 399/795] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:53:21.325867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a3939-a317-45f1-9f50-5e2f67882f0b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.347818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d544aa1-9434-4148-a353-9d46411d39ba None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.387160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f1766-f9c0-4aed-8914-50473de8b3e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.390155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f1766-f9c0-4aed-8914-50473de8b3e2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.390572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f1766-f9c0-4aed-8914-50473de8b3e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.391104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641f1766-f9c0-4aed-8914-50473de8b3e2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.403099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641f1766-f9c0-4aed-8914-50473de8b3e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-641f1766-f9c0-4aed-8914-50473de8b3e2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:21.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:21.409564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:21.410597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:21.412984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 397/796] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:21.413948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f1766-f9c0-4aed-8914-50473de8b3e2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.436181 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94a3939-a317-45f1-9f50-5e2f67882f0b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.472720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11479e2-d9c0-4019-9e16-1e8e8fe59892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.473358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11479e2-d9c0-4019-9e16-1e8e8fe59892 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.473632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11479e2-d9c0-4019-9e16-1e8e8fe59892 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.473900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11479e2-d9c0-4019-9e16-1e8e8fe59892 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.486298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11479e2-d9c0-4019-9e16-1e8e8fe59892 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.487744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11479e2-d9c0-4019-9e16-1e8e8fe59892 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.502824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-e11479e2-d9c0-4019-9e16-1e8e8fe59892 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:21.506910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:21.508005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:21.511798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:21.511798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:21.511798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:21.511798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 400/797] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:21.511798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11479e2-d9c0-4019-9e16-1e8e8fe59892 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.531730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641f1766-f9c0-4aed-8914-50473de8b3e2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.552115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.568178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3095e613-e4d1-49b2-8268-a8bba4cf31b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.568809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e613-e4d1-49b2-8268-a8bba4cf31b9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.569079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e613-e4d1-49b2-8268-a8bba4cf31b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.569347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3095e613-e4d1-49b2-8268-a8bba4cf31b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.580488 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e613-e4d1-49b2-8268-a8bba4cf31b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.581965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3095e613-e4d1-49b2-8268-a8bba4cf31b9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3095e613-e4d1-49b2-8268-a8bba4cf31b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:21.597165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:21.603135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:21.604159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:21.604159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:21.604159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:21.604159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 398/798] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:21.604159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aee1b5-1a90-4123-aef0-055d36d58996 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.604159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aee1b5-1a90-4123-aef0-055d36d58996 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.604159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aee1b5-1a90-4123-aef0-055d36d58996 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.604159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 399/799] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:21.604159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aee1b5-1a90-4123-aef0-055d36d58996 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.627245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11479e2-d9c0-4019-9e16-1e8e8fe59892 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.663462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82c8b-440e-413f-8188-ca4e220ffa68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.664349 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82c8b-440e-413f-8188-ca4e220ffa68 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.664629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82c8b-440e-413f-8188-ca4e220ffa68 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.664908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b82c8b-440e-413f-8188-ca4e220ffa68 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.665776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82c8b-440e-413f-8188-ca4e220ffa68 None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:21.666411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82c8b-440e-413f-8188-ca4e220ffa68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.668341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b82c8b-440e-413f-8188-ca4e220ffa68 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.678448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 401/800] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:21.680640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82c8b-440e-413f-8188-ca4e220ffa68 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.717853 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83aee1b5-1a90-4123-aef0-055d36d58996 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.747985 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.755220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde4ee8b-1c7b-4d2e-89ee-24eea8afbf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.758336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4ee8b-1c7b-4d2e-89ee-24eea8afbf1e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.758336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4ee8b-1c7b-4d2e-89ee-24eea8afbf1e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.758336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde4ee8b-1c7b-4d2e-89ee-24eea8afbf1e None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.758336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4ee8b-1c7b-4d2e-89ee-24eea8afbf1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:21.758336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4ee8b-1c7b-4d2e-89ee-24eea8afbf1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.759296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde4ee8b-1c7b-4d2e-89ee-24eea8afbf1e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.781578 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 400/801] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:21.782911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8e95-c235-4260-8f98-8a28d92797ea None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.783269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8e95-c235-4260-8f98-8a28d92797ea None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.783609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8d8e95-c235-4260-8f98-8a28d92797ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.790013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:21.795591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b82c8b-440e-413f-8188-ca4e220ffa68 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.801874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ab8d8e95-c235-4260-8f98-8a28d92797ea None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:21.803077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ab8d8e95-c235-4260-8f98-8a28d92797ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:21.830367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23b45e-dfec-4091-84b6-0855d1a99158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:21.831002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b45e-dfec-4091-84b6-0855d1a99158 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:21.831276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b45e-dfec-4091-84b6-0855d1a99158 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:21.831543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e23b45e-dfec-4091-84b6-0855d1a99158 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:21.832182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23b45e-dfec-4091-84b6-0855d1a99158 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:21.832477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23b45e-dfec-4091-84b6-0855d1a99158 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:21.833836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e23b45e-dfec-4091-84b6-0855d1a99158 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:21.849436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 402/802] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:21.849436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23b45e-dfec-4091-84b6-0855d1a99158 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.873647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 401/803] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:21 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:21.874501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8e95-c235-4260-8f98-8a28d92797ea None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:21.969626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e23b45e-dfec-4091-84b6-0855d1a99158 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.980003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8d8e95-c235-4260-8f98-8a28d92797ea None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:21.999746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.006892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9bfdb-3a5d-4da5-a011-27fb6021e7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.007609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9bfdb-3a5d-4da5-a011-27fb6021e7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.007965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9bfdb-3a5d-4da5-a011-27fb6021e7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.008304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9bfdb-3a5d-4da5-a011-27fb6021e7a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.015213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886f2b42-4a33-4a21-8e2a-59ec7a739873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.015917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2b42-4a33-4a21-8e2a-59ec7a739873 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.016262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2b42-4a33-4a21-8e2a-59ec7a739873 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.016630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886f2b42-4a33-4a21-8e2a-59ec7a739873 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.020955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9bfdb-3a5d-4da5-a011-27fb6021e7a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.022557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9bfdb-3a5d-4da5-a011-27fb6021e7a9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.024072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f2b42-4a33-4a21-8e2a-59ec7a739873 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.025608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886f2b42-4a33-4a21-8e2a-59ec7a739873 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-886f2b42-4a33-4a21-8e2a-59ec7a739873 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:22.036966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:22.038094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:22.039050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 402/804] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:22.039653 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23858-de03-48be-a443-ed13025dae20 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.039739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23858-de03-48be-a443-ed13025dae20 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.040005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f23858-de03-48be-a443-ed13025dae20 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-13e9bfdb-3a5d-4da5-a011-27fb6021e7a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:22.040311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:22.041180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:22.042070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:22.042070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:22.042070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:22.048056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 403/805] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:22.048056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f23858-de03-48be-a443-ed13025dae20 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.048253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 403/806] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:22.048253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9bfdb-3a5d-4da5-a011-27fb6021e7a9 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.061093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.157058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9bfdb-3a5d-4da5-a011-27fb6021e7a9 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.159257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f23858-de03-48be-a443-ed13025dae20 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.191578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716a8a72-59f9-454d-ae8b-7793f62d304d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.192191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a8a72-59f9-454d-ae8b-7793f62d304d None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.192475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a8a72-59f9-454d-ae8b-7793f62d304d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.192752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716a8a72-59f9-454d-ae8b-7793f62d304d None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.193317 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f5f41-d8a1-47d8-a3b8-e89acfcb7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.193484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a8a72-59f9-454d-ae8b-7793f62d304d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:22.193789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a8a72-59f9-454d-ae8b-7793f62d304d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.193933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f5f41-d8a1-47d8-a3b8-e89acfcb7cab None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.194206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f5f41-d8a1-47d8-a3b8-e89acfcb7cab None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.194471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7f5f41-d8a1-47d8-a3b8-e89acfcb7cab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.195278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716a8a72-59f9-454d-ae8b-7793f62d304d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.201645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f5f41-d8a1-47d8-a3b8-e89acfcb7cab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.203097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7f5f41-d8a1-47d8-a3b8-e89acfcb7cab None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.212975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 404/807] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3e7f5f41-d8a1-47d8-a3b8-e89acfcb7cab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:22.214256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:22.215633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:22.216528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:22.216528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:22.216528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:22.216528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:22.216528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:22.216528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:22.216528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:22.216528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:22.216960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc109-b210-4ae7-af60-cfea70df43ba None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.216960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc109-b210-4ae7-af60-cfea70df43ba None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.216960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecc109-b210-4ae7-af60-cfea70df43ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.217148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 404/808] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:22.217148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f5f41-d8a1-47d8-a3b8-e89acfcb7cab None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.237352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-dfecc109-b210-4ae7-af60-cfea70df43ba None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:22.238553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-dfecc109-b210-4ae7-af60-cfea70df43ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:22.264393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.300797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.306977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 405/809] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:22.307841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecc109-b210-4ae7-af60-cfea70df43ba None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.322580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7f5f41-d8a1-47d8-a3b8-e89acfcb7cab None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.356647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acea052-6965-4f6e-ac48-6ef7ce514c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.357308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acea052-6965-4f6e-ac48-6ef7ce514c31 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.357588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acea052-6965-4f6e-ac48-6ef7ce514c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.357869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acea052-6965-4f6e-ac48-6ef7ce514c31 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.358498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acea052-6965-4f6e-ac48-6ef7ce514c31 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:22.358823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acea052-6965-4f6e-ac48-6ef7ce514c31 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.360199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acea052-6965-4f6e-ac48-6ef7ce514c31 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.371835 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 405/810] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:22.372524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acea052-6965-4f6e-ac48-6ef7ce514c31 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.420726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecc109-b210-4ae7-af60-cfea70df43ba None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.455530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582eebb-801c-43c9-9f2a-09afafca2bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.457423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582eebb-801c-43c9-9f2a-09afafca2bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.458445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582eebb-801c-43c9-9f2a-09afafca2bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.458818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4582eebb-801c-43c9-9f2a-09afafca2bd3 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.459473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582eebb-801c-43c9-9f2a-09afafca2bd3 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.460952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4582eebb-801c-43c9-9f2a-09afafca2bd3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-4582eebb-801c-43c9-9f2a-09afafca2bd3 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:22.469912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:22.471130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:22.471984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 406/811] 10.222.0.59 () {56 vars in 1129 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:22.472766 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582eebb-801c-43c9-9f2a-09afafca2bd3 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.484116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.487347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acea052-6965-4f6e-ac48-6ef7ce514c31 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.527696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbe75a-6fd2-40c9-9670-ac63b9fac125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.528407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbe75a-6fd2-40c9-9670-ac63b9fac125 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.528588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbe75a-6fd2-40c9-9670-ac63b9fac125 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.528854 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbe75a-6fd2-40c9-9670-ac63b9fac125 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.529543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbe75a-6fd2-40c9-9670-ac63b9fac125 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:22.529954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbe75a-6fd2-40c9-9670-ac63b9fac125 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.531311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbe75a-6fd2-40c9-9670-ac63b9fac125 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.543881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 406/812] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:22.544042 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.544881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbe75a-6fd2-40c9-9670-ac63b9fac125 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.590130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4582eebb-801c-43c9-9f2a-09afafca2bd3 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.623741 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762db552-45e3-4a7f-93a1-8fdbacd6fe45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.624371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762db552-45e3-4a7f-93a1-8fdbacd6fe45 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.624649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762db552-45e3-4a7f-93a1-8fdbacd6fe45 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.624916 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762db552-45e3-4a7f-93a1-8fdbacd6fe45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.636514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762db552-45e3-4a7f-93a1-8fdbacd6fe45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.637960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762db552-45e3-4a7f-93a1-8fdbacd6fe45 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.648673 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbe75a-6fd2-40c9-9670-ac63b9fac125 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-762db552-45e3-4a7f-93a1-8fdbacd6fe45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:22.652522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:22.653596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:22.654566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:22.654566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:22.654566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:22.654566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 407/813] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:22.654900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762db552-45e3-4a7f-93a1-8fdbacd6fe45 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.682224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d2738-8af3-4089-813e-d6ac01200069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.682953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2738-8af3-4089-813e-d6ac01200069 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.683407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2738-8af3-4089-813e-d6ac01200069 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.683646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3d2738-8af3-4089-813e-d6ac01200069 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.690718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d2738-8af3-4089-813e-d6ac01200069 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.692180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3d2738-8af3-4089-813e-d6ac01200069 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-bb3d2738-8af3-4089-813e-d6ac01200069 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:22.703841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:22.704869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 407/814] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:22.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d2738-8af3-4089-813e-d6ac01200069 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.730637 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.758415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762db552-45e3-4a7f-93a1-8fdbacd6fe45 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.775218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.800304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9baed2-e20d-4b8c-95c6-24f6e0a0ca30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.800838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9baed2-e20d-4b8c-95c6-24f6e0a0ca30 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.801108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9baed2-e20d-4b8c-95c6-24f6e0a0ca30 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.801385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9baed2-e20d-4b8c-95c6-24f6e0a0ca30 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.802033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9baed2-e20d-4b8c-95c6-24f6e0a0ca30 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:22.802329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9baed2-e20d-4b8c-95c6-24f6e0a0ca30 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.803728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9baed2-e20d-4b8c-95c6-24f6e0a0ca30 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.808137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 408/815] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:22.811817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9baed2-e20d-4b8c-95c6-24f6e0a0ca30 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.821037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3d2738-8af3-4089-813e-d6ac01200069 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.856393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8041f-6331-41f5-b4a0-be877f759569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.857029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8041f-6331-41f5-b4a0-be877f759569 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.857306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8041f-6331-41f5-b4a0-be877f759569 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.857574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb8041f-6331-41f5-b4a0-be877f759569 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.858306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8041f-6331-41f5-b4a0-be877f759569 None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=c6ceb08f9eda4942a510bfaa0f0ef84e) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:22.858609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8041f-6331-41f5-b4a0-be877f759569 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.860091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb8041f-6331-41f5-b4a0-be877f759569 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.865861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 408/816] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/role_assignments?user.id=c6ceb08f9eda4942a510bfaa0f0ef84e&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=85a146946817410b9a3addcf041c5909 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:22.866630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8041f-6331-41f5-b4a0-be877f759569 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:22.930341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9baed2-e20d-4b8c-95c6-24f6e0a0ca30 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.962176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:22.971485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60ff2-5532-492a-b7b8-d69429796a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:22.972118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60ff2-5532-492a-b7b8-d69429796a61 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:22.972423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60ff2-5532-492a-b7b8-d69429796a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:22.972682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd60ff2-5532-492a-b7b8-d69429796a61 None admin] PATH_INFO: `/v3/services/network` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:22.973283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd60ff2-5532-492a-b7b8-d69429796a61 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:22.974700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd60ff2-5532-492a-b7b8-d69429796a61 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:22.981465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb8041f-6331-41f5-b4a0-be877f759569 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-5fd60ff2-5532-492a-b7b8-d69429796a61 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:22.984168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:22.985168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:22.986027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 409/817] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/services/network => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:22.986946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60ff2-5532-492a-b7b8-d69429796a61 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.029986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479f38-86bc-4deb-aaa5-58b417e78972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.030589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479f38-86bc-4deb-aaa5-58b417e78972 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.030908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479f38-86bc-4deb-aaa5-58b417e78972 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.031182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7479f38-86bc-4deb-aaa5-58b417e78972 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.031815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479f38-86bc-4deb-aaa5-58b417e78972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:23.032114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479f38-86bc-4deb-aaa5-58b417e78972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.033493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7479f38-86bc-4deb-aaa5-58b417e78972 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.038000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.048868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 409/818] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:23.049740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479f38-86bc-4deb-aaa5-58b417e78972 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.111424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd60ff2-5532-492a-b7b8-d69429796a61 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.149002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d0ad-ea4f-4cb9-8d8f-f5baa571e59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.149831 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d0ad-ea4f-4cb9-8d8f-f5baa571e59c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.150216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d0ad-ea4f-4cb9-8d8f-f5baa571e59c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.150625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d8d0ad-ea4f-4cb9-8d8f-f5baa571e59c None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.151523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8d0ad-ea4f-4cb9-8d8f-f5baa571e59c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:23.151972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8d0ad-ea4f-4cb9-8d8f-f5baa571e59c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.153416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d8d0ad-ea4f-4cb9-8d8f-f5baa571e59c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.164504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7479f38-86bc-4deb-aaa5-58b417e78972 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.175594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 410/819] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Aug 18 20:53:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:23.175594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d0ad-ea4f-4cb9-8d8f-f5baa571e59c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.206473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b6b41-0ffc-4f37-9986-4366b52580dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.207131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b6b41-0ffc-4f37-9986-4366b52580dd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.207408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b6b41-0ffc-4f37-9986-4366b52580dd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.207676 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06b6b41-0ffc-4f37-9986-4366b52580dd None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.208311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b6b41-0ffc-4f37-9986-4366b52580dd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:23.208607 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b6b41-0ffc-4f37-9986-4366b52580dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.209981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06b6b41-0ffc-4f37-9986-4366b52580dd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.219562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 410/820] 10.222.0.59 () {56 vars in 1124 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:23.219562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b6b41-0ffc-4f37-9986-4366b52580dd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.227942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.281227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.284976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d8d0ad-ea4f-4cb9-8d8f-f5baa571e59c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.323699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06b6b41-0ffc-4f37-9986-4366b52580dd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.327834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cc829-1fc3-477a-aee1-b75592351b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.329017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc829-1fc3-477a-aee1-b75592351b37 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.329494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc829-1fc3-477a-aee1-b75592351b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.329953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45cc829-1fc3-477a-aee1-b75592351b37 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.330811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cc829-1fc3-477a-aee1-b75592351b37 None admin] RBAC: Adding query filter params (name=network) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:23.331337 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cc829-1fc3-477a-aee1-b75592351b37 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.332777 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45cc829-1fc3-477a-aee1-b75592351b37 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.337894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 411/821] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:23.343357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cc829-1fc3-477a-aee1-b75592351b37 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.359441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa187b1-0033-4c79-b480-72686c296363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.360087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa187b1-0033-4c79-b480-72686c296363 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.360367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa187b1-0033-4c79-b480-72686c296363 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.360631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa187b1-0033-4c79-b480-72686c296363 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.367906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa187b1-0033-4c79-b480-72686c296363 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.369300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa187b1-0033-4c79-b480-72686c296363 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8fa187b1-0033-4c79-b480-72686c296363 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:23.381395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:23.382361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:23.383768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:23.383768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:23.383768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:23.383768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:23.383768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:23.383768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:23.383768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:23.383768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:23.383768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 411/822] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:23.383768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa187b1-0033-4c79-b480-72686c296363 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.454324 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.456789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45cc829-1fc3-477a-aee1-b75592351b37 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.490211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa187b1-0033-4c79-b480-72686c296363 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.493860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af395f0-8b4c-4ad0-b045-df162acf102d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.494494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af395f0-8b4c-4ad0-b045-df162acf102d None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.494791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af395f0-8b4c-4ad0-b045-df162acf102d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.495121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af395f0-8b4c-4ad0-b045-df162acf102d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.506299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af395f0-8b4c-4ad0-b045-df162acf102d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.507784 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af395f0-8b4c-4ad0-b045-df162acf102d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-1af395f0-8b4c-4ad0-b045-df162acf102d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:23.522448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:23.523635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:23.524555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:23.524555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:23.524555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:23.529266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 412/823] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:23.530497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af395f0-8b4c-4ad0-b045-df162acf102d None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.530742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e52613-b753-4600-9287-534b29956b0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.531411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e52613-b753-4600-9287-534b29956b0b None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.531691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e52613-b753-4600-9287-534b29956b0b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.531962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e52613-b753-4600-9287-534b29956b0b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.532628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e52613-b753-4600-9287-534b29956b0b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.534012 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e52613-b753-4600-9287-534b29956b0b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.554657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.558629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 412/824] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:23 2022] POST /identity/v3/endpoints => generated 346 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:23.559421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e52613-b753-4600-9287-534b29956b0b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.686583 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af395f0-8b4c-4ad0-b045-df162acf102d None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.697264 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e52613-b753-4600-9287-534b29956b0b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.724209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.732975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806418ae-3493-46c1-8330-af8adaf432e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.733881 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806418ae-3493-46c1-8330-af8adaf432e7 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.734159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806418ae-3493-46c1-8330-af8adaf432e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.734430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806418ae-3493-46c1-8330-af8adaf432e7 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.735268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806418ae-3493-46c1-8330-af8adaf432e7 None admin] RBAC: Adding query filter params (type=network) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:23.735571 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806418ae-3493-46c1-8330-af8adaf432e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.737441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806418ae-3493-46c1-8330-af8adaf432e7 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.741338 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379aea98-eeb4-408a-862d-ff2408849f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.742223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aea98-eeb4-408a-862d-ff2408849f00 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.742504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aea98-eeb4-408a-862d-ff2408849f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.742798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379aea98-eeb4-408a-862d-ff2408849f00 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.746346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 413/825] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/services?type=network => generated 350 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:23.746468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379aea98-eeb4-408a-862d-ff2408849f00 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:23.746468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379aea98-eeb4-408a-862d-ff2408849f00 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.746602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806418ae-3493-46c1-8330-af8adaf432e7 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.746684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379aea98-eeb4-408a-862d-ff2408849f00 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.768412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 413/826] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:23.769694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379aea98-eeb4-408a-862d-ff2408849f00 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.855829 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:23.880953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379aea98-eeb4-408a-862d-ff2408849f00 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.882914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806418ae-3493-46c1-8330-af8adaf432e7 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:23.923178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41d8c5-6727-4053-beba-5120861e7de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.923789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41d8c5-6727-4053-beba-5120861e7de5 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.924068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41d8c5-6727-4053-beba-5120861e7de5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.924337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f41d8c5-6727-4053-beba-5120861e7de5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.924999 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41d8c5-6727-4053-beba-5120861e7de5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.926374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f41d8c5-6727-4053-beba-5120861e7de5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.928318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413696a2-c3a8-423a-a867-3b4c847fa375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:23.929187 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413696a2-c3a8-423a-a867-3b4c847fa375 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:23.929853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413696a2-c3a8-423a-a867-3b4c847fa375 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:23.930270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413696a2-c3a8-423a-a867-3b4c847fa375 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:23.931399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413696a2-c3a8-423a-a867-3b4c847fa375 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:23.931872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413696a2-c3a8-423a-a867-3b4c847fa375 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:23.934604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413696a2-c3a8-423a-a867-3b4c847fa375 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:23.951190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 414/827] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:23 2022] POST /identity/v3/endpoints => generated 337 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:23.952106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 414/828] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:23.952217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41d8c5-6727-4053-beba-5120861e7de5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:23.958821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413696a2-c3a8-423a-a867-3b4c847fa375 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.067041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.124595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413696a2-c3a8-423a-a867-3b4c847fa375 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.173171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b238-9e00-49ea-a566-b0bd452b77a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.174158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b238-9e00-49ea-a566-b0bd452b77a3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.174598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b238-9e00-49ea-a566-b0bd452b77a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.175051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba4b238-9e00-49ea-a566-b0bd452b77a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.178189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.183453 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4b238-9e00-49ea-a566-b0bd452b77a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.185247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba4b238-9e00-49ea-a566-b0bd452b77a3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.190933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f41d8c5-6727-4053-beba-5120861e7de5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-0ba4b238-9e00-49ea-a566-b0bd452b77a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:24.200363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:24.201364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:24.202257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:24.202257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:24.202257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:24.202257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:24.202257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:24.202257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:24.202257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:24.202257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:24.202257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 415/829] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:24.207112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b238-9e00-49ea-a566-b0bd452b77a3 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.238203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3524442-3751-4d69-b56c-d031ea362663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.239413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3524442-3751-4d69-b56c-d031ea362663 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.239885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3524442-3751-4d69-b56c-d031ea362663 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.240365 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3524442-3751-4d69-b56c-d031ea362663 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/410e8bceb7664e1d9968f85f41cc0828/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.248202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3524442-3751-4d69-b56c-d031ea362663 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=410e8bceb7664e1d9968f85f41cc0828, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.249654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3524442-3751-4d69-b56c-d031ea362663 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.267652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 415/830] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:23 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/410e8bceb7664e1d9968f85f41cc0828/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:24.326959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba4b238-9e00-49ea-a566-b0bd452b77a3 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.369560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3585146-eb52-4f19-bb4c-800c6eb4c832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.371040 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3585146-eb52-4f19-bb4c-800c6eb4c832 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.371514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3585146-eb52-4f19-bb4c-800c6eb4c832 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.371928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3585146-eb52-4f19-bb4c-800c6eb4c832 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.372786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3585146-eb52-4f19-bb4c-800c6eb4c832 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:24.373239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3585146-eb52-4f19-bb4c-800c6eb4c832 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.374971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3585146-eb52-4f19-bb4c-800c6eb4c832 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.389259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 416/831] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:24.394949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3524442-3751-4d69-b56c-d031ea362663 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:24.511740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:24.521160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3524442-3751-4d69-b56c-d031ea362663 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:24.560784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8953b7d2-ff6a-4ef7-8e51-8a8d4deddc93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:24.561443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953b7d2-ff6a-4ef7-8e51-8a8d4deddc93 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.561716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953b7d2-ff6a-4ef7-8e51-8a8d4deddc93 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.561983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8953b7d2-ff6a-4ef7-8e51-8a8d4deddc93 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/773fb77106de4530a089e7abca48e333/roles/9b6f095785d54dbe9e3c0b35fff633d2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.578081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953b7d2-ff6a-4ef7-8e51-8a8d4deddc93 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=773fb77106de4530a089e7abca48e333, role_id=9b6f095785d54dbe9e3c0b35fff633d2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:24.579550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8953b7d2-ff6a-4ef7-8e51-8a8d4deddc93 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:24.598002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 416/832] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:24 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/773fb77106de4530a089e7abca48e333/roles/9b6f095785d54dbe9e3c0b35fff633d2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:24.914699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5462340-23c3-43d2-b453-7dde4222164a None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.915131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5462340-23c3-43d2-b453-7dde4222164a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.915321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5462340-23c3-43d2-b453-7dde4222164a None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.916950 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 417/833] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:24.922153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9f7c8-44f4-4fd2-9f86-17bc552ac21e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:24.922448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9f7c8-44f4-4fd2-9f86-17bc552ac21e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:24.922726 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9f7c8-44f4-4fd2-9f86-17bc552ac21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:24.941194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4aa9f7c8-44f4-4fd2-9f86-17bc552ac21e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:24.942390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4aa9f7c8-44f4-4fd2-9f86-17bc552ac21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:25.016353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 417/834] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:24 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:25.280546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5462340-23c3-43d2-b453-7dde4222164a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.341235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:25.389245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5462340-23c3-43d2-b453-7dde4222164a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.424797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a531f8a-62fe-486a-af53-aa96d1f206f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.425436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a531f8a-62fe-486a-af53-aa96d1f206f0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.425713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a531f8a-62fe-486a-af53-aa96d1f206f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.425983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a531f8a-62fe-486a-af53-aa96d1f206f0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.426567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a531f8a-62fe-486a-af53-aa96d1f206f0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.427989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a531f8a-62fe-486a-af53-aa96d1f206f0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-7a531f8a-62fe-486a-af53-aa96d1f206f0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:25.437095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:25.438047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:53:25.439255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:25.442908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 418/835] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:25.444657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9f7c8-44f4-4fd2-9f86-17bc552ac21e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.527730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:25.554229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9f7c8-44f4-4fd2-9f86-17bc552ac21e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.592033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a1925-aa0a-4740-ae5c-f1f7201e0c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.593025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a1925-aa0a-4740-ae5c-f1f7201e0c43 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.593519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a1925-aa0a-4740-ae5c-f1f7201e0c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.594004 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a1925-aa0a-4740-ae5c-f1f7201e0c43 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.594887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a1925-aa0a-4740-ae5c-f1f7201e0c43 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:25.595389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a1925-aa0a-4740-ae5c-f1f7201e0c43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.596959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a1925-aa0a-4740-ae5c-f1f7201e0c43 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.602283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 418/836] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:25.611415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a531f8a-62fe-486a-af53-aa96d1f206f0 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:25.719984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a531f8a-62fe-486a-af53-aa96d1f206f0 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:25.721875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322493d5-fc8c-45e2-b62b-ae1735db39e3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.722389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322493d5-fc8c-45e2-b62b-ae1735db39e3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.722919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322493d5-fc8c-45e2-b62b-ae1735db39e3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.724720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 419/837] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:25.730195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24280ff3-b105-4c36-b8ab-e8c7db9f6994 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.731135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24280ff3-b105-4c36-b8ab-e8c7db9f6994 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.731612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24280ff3-b105-4c36-b8ab-e8c7db9f6994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.741694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:25.752146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-24280ff3-b105-4c36-b8ab-e8c7db9f6994 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:25.753638 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-24280ff3-b105-4c36-b8ab-e8c7db9f6994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:25.757314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2996b03-fc34-4ea2-ba51-285f6357b1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:25.757881 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2996b03-fc34-4ea2-ba51-285f6357b1e3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:25.758202 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2996b03-fc34-4ea2-ba51-285f6357b1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:25.758481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2996b03-fc34-4ea2-ba51-285f6357b1e3 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:25.759142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2996b03-fc34-4ea2-ba51-285f6357b1e3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:25.759447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2996b03-fc34-4ea2-ba51-285f6357b1e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:25.760982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2996b03-fc34-4ea2-ba51-285f6357b1e3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:25.770936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 419/838] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:25 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:25.837652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 420/839] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:26.116842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2996b03-fc34-4ea2-ba51-285f6357b1e3 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.237963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2996b03-fc34-4ea2-ba51-285f6357b1e3 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.275270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5b146-fe6a-463e-b6f1-91ffbc1bcb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.276524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5b146-fe6a-463e-b6f1-91ffbc1bcb64 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.277530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5b146-fe6a-463e-b6f1-91ffbc1bcb64 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.278006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c5b146-fe6a-463e-b6f1-91ffbc1bcb64 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.278817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5b146-fe6a-463e-b6f1-91ffbc1bcb64 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.280400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c5b146-fe6a-463e-b6f1-91ffbc1bcb64 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-88c5b146-fe6a-463e-b6f1-91ffbc1bcb64 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:26.289822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:26.290838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:53:26.291694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:26.295027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 420/840] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:26 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:26.301010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5b146-fe6a-463e-b6f1-91ffbc1bcb64 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.301925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa5d7-a7f9-49c5-b447-356000bb89b8 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.302429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa5d7-a7f9-49c5-b447-356000bb89b8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.302940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2fa5d7-a7f9-49c5-b447-356000bb89b8 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.304943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 421/841] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:26.310540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c4310-6115-4fc0-9815-df61e2457fc8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.310839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c4310-6115-4fc0-9815-df61e2457fc8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.311105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c4310-6115-4fc0-9815-df61e2457fc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.332705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-811c4310-6115-4fc0-9815-df61e2457fc8 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:26.334041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-811c4310-6115-4fc0-9815-df61e2457fc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.363161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:26.424109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:26.424578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c5b146-fe6a-463e-b6f1-91ffbc1bcb64 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.432297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 422/842] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:26.471502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0940870-cadf-43f3-814f-e920cc595845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.472556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940870-cadf-43f3-814f-e920cc595845 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.473110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940870-cadf-43f3-814f-e920cc595845 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.473581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0940870-cadf-43f3-814f-e920cc595845 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.474413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0940870-cadf-43f3-814f-e920cc595845 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:26.474944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0940870-cadf-43f3-814f-e920cc595845 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.476636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0940870-cadf-43f3-814f-e920cc595845 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.482221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 421/843] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:26 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:26.488144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c4310-6115-4fc0-9815-df61e2457fc8 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.516170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36442-77e9-4eb3-9eea-34240e2eb90e None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.517080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36442-77e9-4eb3-9eea-34240e2eb90e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.517609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c36442-77e9-4eb3-9eea-34240e2eb90e None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.520139 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 422/844] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:26.526981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66327-74cf-4a0e-8db6-11f44453bbf6 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.527875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66327-74cf-4a0e-8db6-11f44453bbf6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.528622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f66327-74cf-4a0e-8db6-11f44453bbf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.558155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-c6f66327-74cf-4a0e-8db6-11f44453bbf6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:26.559926 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c6f66327-74cf-4a0e-8db6-11f44453bbf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:26.606407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811c4310-6115-4fc0-9815-df61e2457fc8 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.636587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 423/845] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:26 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:26.648211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc256b88-57a5-4ecd-9d73-1f67a2ba08ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.649084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc256b88-57a5-4ecd-9d73-1f67a2ba08ad None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.649535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc256b88-57a5-4ecd-9d73-1f67a2ba08ad None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.650046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc256b88-57a5-4ecd-9d73-1f67a2ba08ad None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.650886 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc256b88-57a5-4ecd-9d73-1f67a2ba08ad None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:26.651520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc256b88-57a5-4ecd-9d73-1f67a2ba08ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:26.653194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc256b88-57a5-4ecd-9d73-1f67a2ba08ad None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:26.658613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 423/846] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:26 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:26.699343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f66327-74cf-4a0e-8db6-11f44453bbf6 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.749951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:26.813168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f66327-74cf-4a0e-8db6-11f44453bbf6 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:26.853179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3e328-6622-4fb9-9006-0efbb6f88bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:26.855615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3e328-6622-4fb9-9006-0efbb6f88bec None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:26.856116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3e328-6622-4fb9-9006-0efbb6f88bec None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:26.856559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e3e328-6622-4fb9-9006-0efbb6f88bec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:26.869976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e3e328-6622-4fb9-9006-0efbb6f88bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-d0e3e328-6622-4fb9-9006-0efbb6f88bec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:26.875097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:26.876138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:26.876975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:26.879587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 424/847] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:26.886803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc256b88-57a5-4ecd-9d73-1f67a2ba08ad None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.905982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3e328-6622-4fb9-9006-0efbb6f88bec None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:26.956597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.001922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc256b88-57a5-4ecd-9d73-1f67a2ba08ad None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.032878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e3e328-6622-4fb9-9006-0efbb6f88bec None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.035179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.044452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6765134-792c-4025-8d9d-df15e0841d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.045263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6765134-792c-4025-8d9d-df15e0841d2c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.045757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6765134-792c-4025-8d9d-df15e0841d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.046190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6765134-792c-4025-8d9d-df15e0841d2c None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.047033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6765134-792c-4025-8d9d-df15e0841d2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:27.047517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6765134-792c-4025-8d9d-df15e0841d2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.049017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6765134-792c-4025-8d9d-df15e0841d2c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.060753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 424/848] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:27.070740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6765134-792c-4025-8d9d-df15e0841d2c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.079356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca213d9-a6a5-49e0-b162-5831544140f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.080203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca213d9-a6a5-49e0-b162-5831544140f2 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.080653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca213d9-a6a5-49e0-b162-5831544140f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.081414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca213d9-a6a5-49e0-b162-5831544140f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.094350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca213d9-a6a5-49e0-b162-5831544140f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-2ca213d9-a6a5-49e0-b162-5831544140f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:27.101047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:27.102192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:53:27.103232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:27.105244 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 425/849] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:53:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:27.118797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca213d9-a6a5-49e0-b162-5831544140f2 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.183309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6765134-792c-4025-8d9d-df15e0841d2c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.210361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.218015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca213d9-a6a5-49e0-b162-5831544140f2 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.220262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578089-8445-400a-9c8a-e47667a6a6c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.221085 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578089-8445-400a-9c8a-e47667a6a6c4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.221517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578089-8445-400a-9c8a-e47667a6a6c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.221941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab578089-8445-400a-9c8a-e47667a6a6c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.233395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab578089-8445-400a-9c8a-e47667a6a6c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.235139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab578089-8445-400a-9c8a-e47667a6a6c4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ab578089-8445-400a-9c8a-e47667a6a6c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:27.250039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:27.251250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:27.252255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:27.252255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:27.252255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:27.253752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 425/850] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:27.258825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a6f96-3647-4ca6-a58e-edc55122023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.258825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6f96-3647-4ca6-a58e-edc55122023e None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.258825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6f96-3647-4ca6-a58e-edc55122023e None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.258825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654a6f96-3647-4ca6-a58e-edc55122023e None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.259189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a6f96-3647-4ca6-a58e-edc55122023e None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:27.259189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a6f96-3647-4ca6-a58e-edc55122023e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.259428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654a6f96-3647-4ca6-a58e-edc55122023e None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.260386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578089-8445-400a-9c8a-e47667a6a6c4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.269030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 426/851] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:27.274598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a6f96-3647-4ca6-a58e-edc55122023e None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.309454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.373167 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab578089-8445-400a-9c8a-e47667a6a6c4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.408294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654a6f96-3647-4ca6-a58e-edc55122023e None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.411170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4688b3a-42f0-4ed6-ab29-9547650d1c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.412129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4688b3a-42f0-4ed6-ab29-9547650d1c14 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.412677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4688b3a-42f0-4ed6-ab29-9547650d1c14 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.413149 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4688b3a-42f0-4ed6-ab29-9547650d1c14 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.413990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4688b3a-42f0-4ed6-ab29-9547650d1c14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:27.414584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4688b3a-42f0-4ed6-ab29-9547650d1c14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.416278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4688b3a-42f0-4ed6-ab29-9547650d1c14 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.433300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 426/852] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:27.439968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4688b3a-42f0-4ed6-ab29-9547650d1c14 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.453585 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bce4bf-146a-4b9b-8f38-048fd9278a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.454247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bce4bf-146a-4b9b-8f38-048fd9278a41 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.454537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bce4bf-146a-4b9b-8f38-048fd9278a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.455124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bce4bf-146a-4b9b-8f38-048fd9278a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.465975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bce4bf-146a-4b9b-8f38-048fd9278a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.467410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bce4bf-146a-4b9b-8f38-048fd9278a41 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-e9bce4bf-146a-4b9b-8f38-048fd9278a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:27.481956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:27.482971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:27.483874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:27.483874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:27.483874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:27.483874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 427/853] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:27.488724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bce4bf-146a-4b9b-8f38-048fd9278a41 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.494004 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.577157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4688b3a-42f0-4ed6-ab29-9547650d1c14 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.582181 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.607988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bce4bf-146a-4b9b-8f38-048fd9278a41 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.628719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6ceab-21fa-460e-b8e0-6df5e256bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.630012 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6ceab-21fa-460e-b8e0-6df5e256bd7d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.630389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6ceab-21fa-460e-b8e0-6df5e256bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.630755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a6ceab-21fa-460e-b8e0-6df5e256bd7d None admin] PATH_INFO: `/v3/users/swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.641792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6ceab-21fa-460e-b8e0-6df5e256bd7d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.643427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a6ceab-21fa-460e-b8e0-6df5e256bd7d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.645178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cef1-bf6a-4d85-9271-b20a712b7629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.646350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cef1-bf6a-4d85-9271-b20a712b7629 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.646790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cef1-bf6a-4d85-9271-b20a712b7629 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.647198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081cef1-bf6a-4d85-9271-b20a712b7629 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.647974 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081cef1-bf6a-4d85-9271-b20a712b7629 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:27.648422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081cef1-bf6a-4d85-9271-b20a712b7629 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.649944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081cef1-bf6a-4d85-9271-b20a712b7629 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-17a6ceab-21fa-460e-b8e0-6df5e256bd7d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:27.657491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:27.658574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:27.659568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:27.659568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:27.659568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:27.659568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:27.659568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:27.659568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:27.659568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:27.659568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:27.659568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 18 20:53:27.659568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:27.662849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 427/854] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:27.664895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6ceab-21fa-460e-b8e0-6df5e256bd7d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.670863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 428/855] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:27.675926 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cef1-bf6a-4d85-9271-b20a712b7629 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.783310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.786870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081cef1-bf6a-4d85-9271-b20a712b7629 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.787982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a6ceab-21fa-460e-b8e0-6df5e256bd7d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:27.824136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34509ca9-bf7c-431e-944d-baa1e5e728ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.824661 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34509ca9-bf7c-431e-944d-baa1e5e728ad None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.824937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34509ca9-bf7c-431e-944d-baa1e5e728ad None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.825187 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34509ca9-bf7c-431e-944d-baa1e5e728ad None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.826153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab09c2f-1a17-4be9-81b5-827d5a69ee7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:27.826962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab09c2f-1a17-4be9-81b5-827d5a69ee7c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.827237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab09c2f-1a17-4be9-81b5-827d5a69ee7c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.827522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab09c2f-1a17-4be9-81b5-827d5a69ee7c None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.828232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab09c2f-1a17-4be9-81b5-827d5a69ee7c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:27.828532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab09c2f-1a17-4be9-81b5-827d5a69ee7c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.828863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:27.829967 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab09c2f-1a17-4be9-81b5-827d5a69ee7c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.834478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34509ca9-bf7c-431e-944d-baa1e5e728ad None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:27.835962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34509ca9-bf7c-431e-944d-baa1e5e728ad None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-34509ca9-bf7c-431e-944d-baa1e5e728ad None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:27.848148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:27.849138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:27.850068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:27.850068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:27.850068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:27.850068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:27.850068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:27.850068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:27.850068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:27.850068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:27.850068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:27.850068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:27.850606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 428/856] 10.222.0.59 () {56 vars in 1135 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:27.850606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262f3ce-de8b-4042-85e4-d06cb74d7f9b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.851277 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262f3ce-de8b-4042-85e4-d06cb74d7f9b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.851277 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5262f3ce-de8b-4042-85e4-d06cb74d7f9b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.852429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 429/857] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:27.853988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 429/858] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:27.854585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262f3ce-de8b-4042-85e4-d06cb74d7f9b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.860077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9e4d-2008-4b39-bedb-f5c56c43efd6 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:27.860360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9e4d-2008-4b39-bedb-f5c56c43efd6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:27.860630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-880d9e4d-2008-4b39-bedb-f5c56c43efd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:27.878854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-880d9e4d-2008-4b39-bedb-f5c56c43efd6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:27.879958 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-880d9e4d-2008-4b39-bedb-f5c56c43efd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:27.951019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 430/859] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:27.955131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d9e4d-2008-4b39-bedb-f5c56c43efd6 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:27.964017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5262f3ce-de8b-4042-85e4-d06cb74d7f9b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.008862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216170e-e5ba-4cb6-8b40-6573480f048c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.010349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216170e-e5ba-4cb6-8b40-6573480f048c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.010978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216170e-e5ba-4cb6-8b40-6573480f048c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.011437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7216170e-e5ba-4cb6-8b40-6573480f048c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.043763 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.079844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-880d9e4d-2008-4b39-bedb-f5c56c43efd6 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.092281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216170e-e5ba-4cb6-8b40-6573480f048c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.094090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7216170e-e5ba-4cb6-8b40-6573480f048c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.106839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.118968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdcc22-f363-41d2-ba4e-ef077afe4714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.120546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdcc22-f363-41d2-ba4e-ef077afe4714 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.121255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdcc22-f363-41d2-ba4e-ef077afe4714 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.121729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbdcc22-f363-41d2-ba4e-ef077afe4714 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.123292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdcc22-f363-41d2-ba4e-ef077afe4714 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:28.124034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdcc22-f363-41d2-ba4e-ef077afe4714 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.126322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbdcc22-f363-41d2-ba4e-ef077afe4714 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.155350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 431/860] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:28.156666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdcc22-f363-41d2-ba4e-ef077afe4714 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.224135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 430/861] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:27 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:53:28.225441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216170e-e5ba-4cb6-8b40-6573480f048c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.277635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbdcc22-f363-41d2-ba4e-ef077afe4714 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.285442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.315393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2d39c-220d-4267-8a06-f3b37b9549c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.316029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2d39c-220d-4267-8a06-f3b37b9549c0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.316316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2d39c-220d-4267-8a06-f3b37b9549c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.316586 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d2d39c-220d-4267-8a06-f3b37b9549c0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.332124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7216170e-e5ba-4cb6-8b40-6573480f048c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.366720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee00ba-43e0-41f7-ac7a-0574ee42f2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.367384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee00ba-43e0-41f7-ac7a-0574ee42f2db None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.367665 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee00ba-43e0-41f7-ac7a-0574ee42f2db None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.367933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eee00ba-43e0-41f7-ac7a-0574ee42f2db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.373103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.379046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee00ba-43e0-41f7-ac7a-0574ee42f2db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.380550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eee00ba-43e0-41f7-ac7a-0574ee42f2db None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.393779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2d39c-220d-4267-8a06-f3b37b9549c0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.395318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d2d39c-220d-4267-8a06-f3b37b9549c0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-2eee00ba-43e0-41f7-ac7a-0574ee42f2db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:28.395924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:28.396816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:28.397714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:28.397714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:28.397714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:28.397714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 431/862] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:28.398392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee00ba-43e0-41f7-ac7a-0574ee42f2db None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.506623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 432/863] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:53:28.507518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2d39c-220d-4267-8a06-f3b37b9549c0 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.514584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eee00ba-43e0-41f7-ac7a-0574ee42f2db None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.525746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.552410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceb2c1-aac9-415e-baeb-310677f6ec3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.553020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb2c1-aac9-415e-baeb-310677f6ec3b None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.553299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb2c1-aac9-415e-baeb-310677f6ec3b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.553716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ceb2c1-aac9-415e-baeb-310677f6ec3b None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.554294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceb2c1-aac9-415e-baeb-310677f6ec3b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.555724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ceb2c1-aac9-415e-baeb-310677f6ec3b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.579038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 432/864] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:53:28 2022] POST /identity/v3/services => generated 269 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:28.579038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceb2c1-aac9-415e-baeb-310677f6ec3b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.610648 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.635177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d2d39c-220d-4267-8a06-f3b37b9549c0 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.685704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8811c09d-36bc-4a8d-9417-60d9941160cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.686437 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811c09d-36bc-4a8d-9417-60d9941160cc None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.686724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811c09d-36bc-4a8d-9417-60d9941160cc None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.687034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8811c09d-36bc-4a8d-9417-60d9941160cc None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.687697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811c09d-36bc-4a8d-9417-60d9941160cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:28.688001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811c09d-36bc-4a8d-9417-60d9941160cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.689470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8811c09d-36bc-4a8d-9417-60d9941160cc None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.703444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 433/865] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:28.704770 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca8775-bc90-4807-a57d-c3aee4ca3107 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.705060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca8775-bc90-4807-a57d-c3aee4ca3107 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.705331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca8775-bc90-4807-a57d-c3aee4ca3107 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.706744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 434/866] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:28.711631 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca8775-bc90-4807-a57d-c3aee4ca3107 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.719718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ceb2c1-aac9-415e-baeb-310677f6ec3b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.768091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc541c8-133c-45e8-a66c-58f71db39212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.772022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc541c8-133c-45e8-a66c-58f71db39212 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.772022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc541c8-133c-45e8-a66c-58f71db39212 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.772022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc541c8-133c-45e8-a66c-58f71db39212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.785301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc541c8-133c-45e8-a66c-58f71db39212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.786886 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc541c8-133c-45e8-a66c-58f71db39212 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-dbc541c8-133c-45e8-a66c-58f71db39212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:28.802052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:28.803280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:28.804178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:28.804178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:28.804178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:28.804178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 433/867] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:28.804671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a9bc5-ef40-4ba7-9c99-2ab732abbc9f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.804671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a9bc5-ef40-4ba7-9c99-2ab732abbc9f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.805333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a9bc5-ef40-4ba7-9c99-2ab732abbc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.824694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-059a9bc5-ef40-4ba7-9c99-2ab732abbc9f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:28.825879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-059a9bc5-ef40-4ba7-9c99-2ab732abbc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:28.833902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca8775-bc90-4807-a57d-c3aee4ca3107 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:28.842461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.871142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624652-eb5f-49ac-b92e-f83a8f89127d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:28.871777 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624652-eb5f-49ac-b92e-f83a8f89127d None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:28.872053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624652-eb5f-49ac-b92e-f83a8f89127d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:28.872324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49624652-eb5f-49ac-b92e-f83a8f89127d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:28.879064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49624652-eb5f-49ac-b92e-f83a8f89127d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:28.880512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49624652-eb5f-49ac-b92e-f83a8f89127d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:28.882988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-49624652-eb5f-49ac-b92e-f83a8f89127d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:28.892098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:28.893197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:28.894325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:28.894325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:28.894325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:28.894325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:28.894325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:28.894325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:28.894325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:28.894325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:28.896526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 435/868] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:28.897525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624652-eb5f-49ac-b92e-f83a8f89127d None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:28.910644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 434/869] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:28 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:28.911763 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a9bc5-ef40-4ba7-9c99-2ab732abbc9f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.018411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49624652-eb5f-49ac-b92e-f83a8f89127d None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.039463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a9bc5-ef40-4ba7-9c99-2ab732abbc9f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.059472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1dfd-3f7c-4200-adfc-9ddc8ed65ce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.060490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1dfd-3f7c-4200-adfc-9ddc8ed65ce3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.060969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1dfd-3f7c-4200-adfc-9ddc8ed65ce3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.061472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07e1dfd-3f7c-4200-adfc-9ddc8ed65ce3 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.062416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e1dfd-3f7c-4200-adfc-9ddc8ed65ce3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:29.062954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e1dfd-3f7c-4200-adfc-9ddc8ed65ce3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.064544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07e1dfd-3f7c-4200-adfc-9ddc8ed65ce3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.077133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e5c79-90cd-4869-93fc-62c1aa6a172b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.077742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e5c79-90cd-4869-93fc-62c1aa6a172b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.078019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e5c79-90cd-4869-93fc-62c1aa6a172b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.078292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816e5c79-90cd-4869-93fc-62c1aa6a172b None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.079021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e5c79-90cd-4869-93fc-62c1aa6a172b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:29.079326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e5c79-90cd-4869-93fc-62c1aa6a172b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.080743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 436/870] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:29.080851 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816e5c79-90cd-4869-93fc-62c1aa6a172b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.086898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1dfd-3f7c-4200-adfc-9ddc8ed65ce3 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.098399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 435/871] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:29.101582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e5c79-90cd-4869-93fc-62c1aa6a172b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.118826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:29.163823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:29.213136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07e1dfd-3f7c-4200-adfc-9ddc8ed65ce3 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.231349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816e5c79-90cd-4869-93fc-62c1aa6a172b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.254699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a911d74-7091-4ea1-aac6-01cc79f3653d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.255448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a911d74-7091-4ea1-aac6-01cc79f3653d None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.255653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a911d74-7091-4ea1-aac6-01cc79f3653d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.255911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a911d74-7091-4ea1-aac6-01cc79f3653d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.263709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a911d74-7091-4ea1-aac6-01cc79f3653d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.265157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a911d74-7091-4ea1-aac6-01cc79f3653d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.267279 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1a926-67a8-4900-a370-d407eae7f29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.267885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1a926-67a8-4900-a370-d407eae7f29a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.268160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1a926-67a8-4900-a370-d407eae7f29a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.268427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1a926-67a8-4900-a370-d407eae7f29a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.269141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1a926-67a8-4900-a370-d407eae7f29a None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=410e8bceb7664e1d9968f85f41cc0828) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:29.269445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1a926-67a8-4900-a370-d407eae7f29a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.271201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1a926-67a8-4900-a370-d407eae7f29a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-3a911d74-7091-4ea1-aac6-01cc79f3653d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:29.276760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:29.277644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:29.278632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:29.278632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:29.278632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:29.278632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:29.278632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:29.278632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:29.278632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:29.278632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:29.279131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 436/872] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:29 2022] GET /identity/v3/role_assignments?user.id=410e8bceb7664e1d9968f85f41cc0828&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=85a146946817410b9a3addcf041c5909 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:29.279131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1a926-67a8-4900-a370-d407eae7f29a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.283886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 437/873] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:29.289472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a911d74-7091-4ea1-aac6-01cc79f3653d None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.390271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:29.403371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a911d74-7091-4ea1-aac6-01cc79f3653d None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.427200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:29.430484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1a926-67a8-4900-a370-d407eae7f29a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.445669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab09e76-2ad5-4b97-a46a-6531ebbb4872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.446289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09e76-2ad5-4b97-a46a-6531ebbb4872 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.446564 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09e76-2ad5-4b97-a46a-6531ebbb4872 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.446870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab09e76-2ad5-4b97-a46a-6531ebbb4872 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.447572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab09e76-2ad5-4b97-a46a-6531ebbb4872 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:29.448218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab09e76-2ad5-4b97-a46a-6531ebbb4872 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.449365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab09e76-2ad5-4b97-a46a-6531ebbb4872 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.462682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 438/874] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:29.469595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab09e76-2ad5-4b97-a46a-6531ebbb4872 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:29.475520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01652c46-5e8c-4e81-b560-7719e8b7d045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.476136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01652c46-5e8c-4e81-b560-7719e8b7d045 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.476412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01652c46-5e8c-4e81-b560-7719e8b7d045 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.476679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01652c46-5e8c-4e81-b560-7719e8b7d045 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.477328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01652c46-5e8c-4e81-b560-7719e8b7d045 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.478698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01652c46-5e8c-4e81-b560-7719e8b7d045 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.497188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 437/875] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:53:29 2022] POST /identity/v3/services => generated 251 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:29.598758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab09e76-2ad5-4b97-a46a-6531ebbb4872 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:29.649287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0558bf2-a8e8-43b7-b84a-d4f8008e809b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:29.650252 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0558bf2-a8e8-43b7-b84a-d4f8008e809b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:29.650724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0558bf2-a8e8-43b7-b84a-d4f8008e809b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:29.651267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0558bf2-a8e8-43b7-b84a-d4f8008e809b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:29.652314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0558bf2-a8e8-43b7-b84a-d4f8008e809b None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=773fb77106de4530a089e7abca48e333) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:29.652831 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0558bf2-a8e8-43b7-b84a-d4f8008e809b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:29.654475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0558bf2-a8e8-43b7-b84a-d4f8008e809b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:29.661135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 439/876] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:29 2022] GET /identity/v3/role_assignments?user.id=773fb77106de4530a089e7abca48e333&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:30.516646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edbcde-31c1-4fbd-9f50-103ebef4589a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.517183 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edbcde-31c1-4fbd-9f50-103ebef4589a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.517183 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4edbcde-31c1-4fbd-9f50-103ebef4589a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.518746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 438/877] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:30.524522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69728912-e29d-452f-8b2b-08c32c10d07b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:30.524808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69728912-e29d-452f-8b2b-08c32c10d07b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:30.525079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69728912-e29d-452f-8b2b-08c32c10d07b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:30.543464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-69728912-e29d-452f-8b2b-08c32c10d07b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:30.544636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-69728912-e29d-452f-8b2b-08c32c10d07b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:30.580184 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:30.615025 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 440/878] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:30 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:30.878271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edbcde-31c1-4fbd-9f50-103ebef4589a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:30.984842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4edbcde-31c1-4fbd-9f50-103ebef4589a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.027756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43bab2-be9f-4ee1-9823-9fbb8e490c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.028319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43bab2-be9f-4ee1-9823-9fbb8e490c4f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.028601 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43bab2-be9f-4ee1-9823-9fbb8e490c4f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.028877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f43bab2-be9f-4ee1-9823-9fbb8e490c4f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.029472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43bab2-be9f-4ee1-9823-9fbb8e490c4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.030875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f43bab2-be9f-4ee1-9823-9fbb8e490c4f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.035095 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3f43bab2-be9f-4ee1-9823-9fbb8e490c4f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:31.041106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:31.042088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:53:31.043069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:31.043794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 439/879] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Aug 18 20:53:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:31.049018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69728912-e29d-452f-8b2b-08c32c10d07b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.149487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69728912-e29d-452f-8b2b-08c32c10d07b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.185898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff1515-b928-4acf-94e4-e75fa9968c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.186504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff1515-b928-4acf-94e4-e75fa9968c13 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.186793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff1515-b928-4acf-94e4-e75fa9968c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.187064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff1515-b928-4acf-94e4-e75fa9968c13 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.187691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff1515-b928-4acf-94e4-e75fa9968c13 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:31.187985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff1515-b928-4acf-94e4-e75fa9968c13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.189347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff1515-b928-4acf-94e4-e75fa9968c13 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.194382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 441/880] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:31.200281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43bab2-be9f-4ee1-9823-9fbb8e490c4f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.311111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f43bab2-be9f-4ee1-9823-9fbb8e490c4f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.348053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da56a8d-1ebb-4f43-83ed-396591249d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.348666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da56a8d-1ebb-4f43-83ed-396591249d25 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.348952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da56a8d-1ebb-4f43-83ed-396591249d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.349224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da56a8d-1ebb-4f43-83ed-396591249d25 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.349863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da56a8d-1ebb-4f43-83ed-396591249d25 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:31.350168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da56a8d-1ebb-4f43-83ed-396591249d25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.351581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da56a8d-1ebb-4f43-83ed-396591249d25 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.357699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 440/881] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:31.363376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff1515-b928-4acf-94e4-e75fa9968c13 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.377893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898d0c-617d-4248-918f-f80a417f111b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.378499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898d0c-617d-4248-918f-f80a417f111b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.379018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d898d0c-617d-4248-918f-f80a417f111b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.381014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 441/882] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:31.386659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acf478-f913-47f7-892f-bc0e15756c83 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.387345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acf478-f913-47f7-892f-bc0e15756c83 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.387842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37acf478-f913-47f7-892f-bc0e15756c83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.400528 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:31.409820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-37acf478-f913-47f7-892f-bc0e15756c83 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:31.411358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-37acf478-f913-47f7-892f-bc0e15756c83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:31.468411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff1515-b928-4acf-94e4-e75fa9968c13 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.481654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:31.492914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 442/883] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:31.511193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb7f9-8e80-41b6-a1f5-833bdd86d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.516992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb7f9-8e80-41b6-a1f5-833bdd86d6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.517449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb7f9-8e80-41b6-a1f5-833bdd86d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.517903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83eb7f9-8e80-41b6-a1f5-833bdd86d6c7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.518860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb7f9-8e80-41b6-a1f5-833bdd86d6c7 None admin] RBAC: Adding query filter params (interface=public, service_id=b150e883352248a8a80ca08558763a7d, region_id=RegionOne) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:31.519316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb7f9-8e80-41b6-a1f5-833bdd86d6c7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.521176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83eb7f9-8e80-41b6-a1f5-833bdd86d6c7 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.528072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 442/884] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/endpoints?service_id=b150e883352248a8a80ca08558763a7d&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:31.529286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f691cb-37fd-40ec-bbea-9fb3cc539f42 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.529719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f691cb-37fd-40ec-bbea-9fb3cc539f42 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.529869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f691cb-37fd-40ec-bbea-9fb3cc539f42 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.536358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 443/885] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:31.536490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb7f9-8e80-41b6-a1f5-833bdd86d6c7 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.537715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ce02-8da6-4f15-9621-da9e4a86cc1e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.537990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ce02-8da6-4f15-9621-da9e4a86cc1e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.538254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b20ce02-8da6-4f15-9621-da9e4a86cc1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.557789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2b20ce02-8da6-4f15-9621-da9e4a86cc1e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:31.559007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2b20ce02-8da6-4f15-9621-da9e4a86cc1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:31.641281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:31.645867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83eb7f9-8e80-41b6-a1f5-833bdd86d6c7 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.659383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 444/886] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:31.684642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae444c-62c4-4bad-ba23-2d5f7dbbb8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.685245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae444c-62c4-4bad-ba23-2d5f7dbbb8bf None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.685522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae444c-62c4-4bad-ba23-2d5f7dbbb8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.685787 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae444c-62c4-4bad-ba23-2d5f7dbbb8bf None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.686390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae444c-62c4-4bad-ba23-2d5f7dbbb8bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.687792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae444c-62c4-4bad-ba23-2d5f7dbbb8bf None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.693857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 443/887] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/services => generated 1268 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:53:31.762865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f748ea-cd4d-4a77-8431-f53e68dcf276 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.763211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f748ea-cd4d-4a77-8431-f53e68dcf276 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.763415 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f748ea-cd4d-4a77-8431-f53e68dcf276 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.765059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 445/888] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:31.772383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae444c-62c4-4bad-ba23-2d5f7dbbb8bf None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.774703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe28832-8ba6-448a-a614-8324061ccc5b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.774703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe28832-8ba6-448a-a614-8324061ccc5b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.774944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe28832-8ba6-448a-a614-8324061ccc5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.793204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dfe28832-8ba6-448a-a614-8324061ccc5b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:31.794418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dfe28832-8ba6-448a-a614-8324061ccc5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:31.885746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 446/889] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:31 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:31.893601 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae444c-62c4-4bad-ba23-2d5f7dbbb8bf None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:31.927911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f6de-e612-4269-85aa-1c97e5cabe05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:31.928549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f6de-e612-4269-85aa-1c97e5cabe05 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:31.928828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f6de-e612-4269-85aa-1c97e5cabe05 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:31.929106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a5f6de-e612-4269-85aa-1c97e5cabe05 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:31.929683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5f6de-e612-4269-85aa-1c97e5cabe05 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:31.931091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a5f6de-e612-4269-85aa-1c97e5cabe05 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-34a5f6de-e612-4269-85aa-1c97e5cabe05 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:31.940068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:31.941050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:31.941896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 444/890] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:31.949332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe28832-8ba6-448a-a614-8324061ccc5b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:31.970964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f6de-e612-4269-85aa-1c97e5cabe05 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.003219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.014606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.075809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a5f6de-e612-4269-85aa-1c97e5cabe05 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.077662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe28832-8ba6-448a-a614-8324061ccc5b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.114947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e151b7-ca85-4015-a3f7-54f2d0fa4909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.115559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e151b7-ca85-4015-a3f7-54f2d0fa4909 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.115836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e151b7-ca85-4015-a3f7-54f2d0fa4909 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.116103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e151b7-ca85-4015-a3f7-54f2d0fa4909 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.116731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e151b7-ca85-4015-a3f7-54f2d0fa4909 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:32.117083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e151b7-ca85-4015-a3f7-54f2d0fa4909 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.118505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e151b7-ca85-4015-a3f7-54f2d0fa4909 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.120436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb5a6b-ccd2-4efb-ac02-16bc358032c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.121589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb5a6b-ccd2-4efb-ac02-16bc358032c7 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.122154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb5a6b-ccd2-4efb-ac02-16bc358032c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.122664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eb5a6b-ccd2-4efb-ac02-16bc358032c7 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.123410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb5a6b-ccd2-4efb-ac02-16bc358032c7 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.124271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 447/891] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:32.125109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eb5a6b-ccd2-4efb-ac02-16bc358032c7 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.129800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e151b7-ca85-4015-a3f7-54f2d0fa4909 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-70eb5a6b-ccd2-4efb-ac02-16bc358032c7 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:32.135363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:32.136405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:32.137304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 445/892] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:31 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:32.144031 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb5a6b-ccd2-4efb-ac02-16bc358032c7 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.239396 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.249827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e151b7-ca85-4015-a3f7-54f2d0fa4909 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.250834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eb5a6b-ccd2-4efb-ac02-16bc358032c7 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.267766 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.288095 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8c2e-11fb-4b88-81ad-e99b89327e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.288700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8c2e-11fb-4b88-81ad-e99b89327e3c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.288979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8c2e-11fb-4b88-81ad-e99b89327e3c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.289235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8755b8f-83ea-4fab-931c-5ac21e965e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.289371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d8c2e-11fb-4b88-81ad-e99b89327e3c None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.289846 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8755b8f-83ea-4fab-931c-5ac21e965e9a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.289957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d8c2e-11fb-4b88-81ad-e99b89327e3c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:32.290115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8755b8f-83ea-4fab-931c-5ac21e965e9a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.290206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d8c2e-11fb-4b88-81ad-e99b89327e3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.290387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8755b8f-83ea-4fab-931c-5ac21e965e9a None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.291049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8755b8f-83ea-4fab-931c-5ac21e965e9a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:32.291346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8755b8f-83ea-4fab-931c-5ac21e965e9a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.291552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844d8c2e-11fb-4b88-81ad-e99b89327e3c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.292796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8755b8f-83ea-4fab-931c-5ac21e965e9a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.306795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 448/893] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:32.306795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8c2e-11fb-4b88-81ad-e99b89327e3c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.307071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 446/894] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:32.308521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8755b8f-83ea-4fab-931c-5ac21e965e9a None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.419814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844d8c2e-11fb-4b88-81ad-e99b89327e3c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.431845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8755b8f-83ea-4fab-931c-5ac21e965e9a None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.462884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581dd3a-ffcc-4639-8370-3e0be716cf50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.463528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581dd3a-ffcc-4639-8370-3e0be716cf50 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.464000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581dd3a-ffcc-4639-8370-3e0be716cf50 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.464220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e581dd3a-ffcc-4639-8370-3e0be716cf50 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.476026 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e581dd3a-ffcc-4639-8370-3e0be716cf50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:32.477356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3196ce4-80c9-45f3-9848-f2a1c1c5ea12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.477557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3196ce4-80c9-45f3-9848-f2a1c1c5ea12 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.477816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3196ce4-80c9-45f3-9848-f2a1c1c5ea12 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.478084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3196ce4-80c9-45f3-9848-f2a1c1c5ea12 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.478719 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3196ce4-80c9-45f3-9848-f2a1c1c5ea12 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:32.479047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3196ce4-80c9-45f3-9848-f2a1c1c5ea12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.480449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3196ce4-80c9-45f3-9848-f2a1c1c5ea12 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-e581dd3a-ffcc-4639-8370-3e0be716cf50 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:32.481367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:32.482247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:32.483114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 449/895] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:32.488794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 447/896] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:32.488929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581dd3a-ffcc-4639-8370-3e0be716cf50 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.494740 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3196ce4-80c9-45f3-9848-f2a1c1c5ea12 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.520130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.539285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.613938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e581dd3a-ffcc-4639-8370-3e0be716cf50 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.625117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3196ce4-80c9-45f3-9848-f2a1c1c5ea12 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.661380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce80db2-27cb-4121-a0df-1152b4d8d9b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.662162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce80db2-27cb-4121-a0df-1152b4d8d9b9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.662535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce80db2-27cb-4121-a0df-1152b4d8d9b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.662953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce80db2-27cb-4121-a0df-1152b4d8d9b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.663961 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce80db2-27cb-4121-a0df-1152b4d8d9b9 None admin] RBAC: Adding query filter params (interface=public, service_id=780e45fae5584f81812af87a62d14106, region_id=RegionOne) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:32.664362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce80db2-27cb-4121-a0df-1152b4d8d9b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.665129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ffb2a-1600-4093-8b41-f661ba501ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.665915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ffb2a-1600-4093-8b41-f661ba501ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.666030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce80db2-27cb-4121-a0df-1152b4d8d9b9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.666439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ffb2a-1600-4093-8b41-f661ba501ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.666934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ffb2a-1600-4093-8b41-f661ba501ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.667742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ffb2a-1600-4093-8b41-f661ba501ea0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:32.668535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ffb2a-1600-4093-8b41-f661ba501ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.670963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ffb2a-1600-4093-8b41-f661ba501ea0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.676917 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 448/897] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/endpoints?service_id=780e45fae5584f81812af87a62d14106&interface=public®ion_id=RegionOne => generated 194 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:32.677898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce80db2-27cb-4121-a0df-1152b4d8d9b9 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.681193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 450/898] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:32.687487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ffb2a-1600-4093-8b41-f661ba501ea0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:32.784914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.806559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce80db2-27cb-4121-a0df-1152b4d8d9b9 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.831703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ffb2a-1600-4093-8b41-f661ba501ea0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:32.835114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:32.843646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12d064-7834-40f6-8a9d-d110d10a1d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.844454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12d064-7834-40f6-8a9d-d110d10a1d18 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.844900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12d064-7834-40f6-8a9d-d110d10a1d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.845181 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e12d064-7834-40f6-8a9d-d110d10a1d18 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.845811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12d064-7834-40f6-8a9d-d110d10a1d18 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.847286 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e12d064-7834-40f6-8a9d-d110d10a1d18 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.860252 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 449/899] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:32.876577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae8e0a-6835-44af-bbbc-a231f048c4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:32.877238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae8e0a-6835-44af-bbbc-a231f048c4be None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:32.877521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae8e0a-6835-44af-bbbc-a231f048c4be None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:32.877799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae8e0a-6835-44af-bbbc-a231f048c4be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:32.892181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae8e0a-6835-44af-bbbc-a231f048c4be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:32.893683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ae8e0a-6835-44af-bbbc-a231f048c4be None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-63ae8e0a-6835-44af-bbbc-a231f048c4be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:32.910789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:32.911801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:32.912680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:32.912680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:32.912680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:32.912680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 451/900] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:32.918613 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12d064-7834-40f6-8a9d-d110d10a1d18 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.036418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e12d064-7834-40f6-8a9d-d110d10a1d18 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.071322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15284301-5d99-4b32-acdc-5dac9565571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.071939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15284301-5d99-4b32-acdc-5dac9565571a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.072219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15284301-5d99-4b32-acdc-5dac9565571a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.072491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15284301-5d99-4b32-acdc-5dac9565571a None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.073743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15284301-5d99-4b32-acdc-5dac9565571a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:33.073854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15284301-5d99-4b32-acdc-5dac9565571a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.075272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15284301-5d99-4b32-acdc-5dac9565571a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.088045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 450/901] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:33.093883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae8e0a-6835-44af-bbbc-a231f048c4be None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.196934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae8e0a-6835-44af-bbbc-a231f048c4be None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.234288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d7b47-dd3e-41f2-a656-7741dc0533ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.235294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d7b47-dd3e-41f2-a656-7741dc0533ec None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.235753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d7b47-dd3e-41f2-a656-7741dc0533ec None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.236198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1d7b47-dd3e-41f2-a656-7741dc0533ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.251885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d7b47-dd3e-41f2-a656-7741dc0533ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.253741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1d7b47-dd3e-41f2-a656-7741dc0533ec None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4e1d7b47-dd3e-41f2-a656-7741dc0533ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:33.266858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:33.267852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:33.268821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:33.268821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:33.268821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:33.268821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:33.268821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:33.268821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:33.268821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:33.268821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:33.268821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:33.268821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:33.271368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 452/902] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Aug 18 20:53:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:33.279645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15284301-5d99-4b32-acdc-5dac9565571a None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.287069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:33.389154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15284301-5d99-4b32-acdc-5dac9565571a None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.424909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65ab267-525b-4223-bfc1-f0c4dc526cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.425532 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ab267-525b-4223-bfc1-f0c4dc526cbd None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.425812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ab267-525b-4223-bfc1-f0c4dc526cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.426083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65ab267-525b-4223-bfc1-f0c4dc526cbd None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.426849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ab267-525b-4223-bfc1-f0c4dc526cbd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:33.427159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ab267-525b-4223-bfc1-f0c4dc526cbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.428608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65ab267-525b-4223-bfc1-f0c4dc526cbd None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.447508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 451/903] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Aug 18 20:53:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:33.453310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d7b47-dd3e-41f2-a656-7741dc0533ec None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.471504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:33.567797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1d7b47-dd3e-41f2-a656-7741dc0533ec None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.604406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162753d-bed0-4719-bceb-05a0fd420c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.605279 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162753d-bed0-4719-bceb-05a0fd420c54 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.605602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162753d-bed0-4719-bceb-05a0fd420c54 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.605878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162753d-bed0-4719-bceb-05a0fd420c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.679560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162753d-bed0-4719-bceb-05a0fd420c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:33.681054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162753d-bed0-4719-bceb-05a0fd420c54 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:33.686940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fc289-5d7d-4e1f-8f9f-3454a6ed50fe None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.687413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fc289-5d7d-4e1f-8f9f-3454a6ed50fe None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.687488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9fc289-5d7d-4e1f-8f9f-3454a6ed50fe None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.689102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 452/904] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:33.693996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aba53-cfe3-493f-8f41-e97f09bc152c None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.694285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aba53-cfe3-493f-8f41-e97f09bc152c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.694558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8aba53-cfe3-493f-8f41-e97f09bc152c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:33.698029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:33.714666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7c8aba53-cfe3-493f-8f41-e97f09bc152c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:33.716013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7c8aba53-cfe3-493f-8f41-e97f09bc152c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:33.796574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:33.818913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 453/905] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:33 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:53:33.819466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 453/906] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:33 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:33.820098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162753d-bed0-4719-bceb-05a0fd420c54 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:33.952617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162753d-bed0-4719-bceb-05a0fd420c54 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:33.968599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:33.996566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca96fa-79fa-4b48-b0db-4a24348263d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:33.997212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca96fa-79fa-4b48-b0db-4a24348263d0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:33.997486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca96fa-79fa-4b48-b0db-4a24348263d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:33.997752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca96fa-79fa-4b48-b0db-4a24348263d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.014339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca96fa-79fa-4b48-b0db-4a24348263d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.015826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca96fa-79fa-4b48-b0db-4a24348263d0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f8ca96fa-79fa-4b48-b0db-4a24348263d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:34.032413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:34.033795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:34.034699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:34.034699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:34.034699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:34.042989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 454/907] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:34.044409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aba53-cfe3-493f-8f41-e97f09bc152c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.109511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca96fa-79fa-4b48-b0db-4a24348263d0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.185890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8aba53-cfe3-493f-8f41-e97f09bc152c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.228230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a708a0-4f68-47f4-9e7a-7654ee510ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.228893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a708a0-4f68-47f4-9e7a-7654ee510ee4 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.229104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a708a0-4f68-47f4-9e7a-7654ee510ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.229432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a708a0-4f68-47f4-9e7a-7654ee510ee4 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.230143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a708a0-4f68-47f4-9e7a-7654ee510ee4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:34.230447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a708a0-4f68-47f4-9e7a-7654ee510ee4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.231868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a708a0-4f68-47f4-9e7a-7654ee510ee4 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.232168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca96fa-79fa-4b48-b0db-4a24348263d0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.257214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 454/908] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:34.258187 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a708a0-4f68-47f4-9e7a-7654ee510ee4 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.278279 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8d1c9-c33d-4aca-9191-cd438b3304b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.279532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8d1c9-c33d-4aca-9191-cd438b3304b7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.280078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8d1c9-c33d-4aca-9191-cd438b3304b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.280550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f8d1c9-c33d-4aca-9191-cd438b3304b7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.281459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8d1c9-c33d-4aca-9191-cd438b3304b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.283181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f8d1c9-c33d-4aca-9191-cd438b3304b7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-36f8d1c9-c33d-4aca-9191-cd438b3304b7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:34.294552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:34.295572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 18 20:53:34.296594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:34.302919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 455/909] 10.222.0.59 () {56 vars in 1132 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:34.306061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8d1c9-c33d-4aca-9191-cd438b3304b7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.326124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:34.343979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:34.387033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a708a0-4f68-47f4-9e7a-7654ee510ee4 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.422899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f8d1c9-c33d-4aca-9191-cd438b3304b7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.426333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8740eb2d-9ee1-4194-8867-581230ab4b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.427035 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740eb2d-9ee1-4194-8867-581230ab4b4a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.427311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740eb2d-9ee1-4194-8867-581230ab4b4a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.427577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8740eb2d-9ee1-4194-8867-581230ab4b4a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.439464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740eb2d-9ee1-4194-8867-581230ab4b4a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.440933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8740eb2d-9ee1-4194-8867-581230ab4b4a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-8740eb2d-9ee1-4194-8867-581230ab4b4a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:34.453053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:34.454068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:34.455003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:34.455003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:34.455003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:34.455003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:34.455003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:34.455003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:34.455003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:34.455003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:34.457964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 455/910] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:34.461009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c52ca-4314-499e-b6d4-7b1415c904c6 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.461298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c52ca-4314-499e-b6d4-7b1415c904c6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.461623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c52ca-4314-499e-b6d4-7b1415c904c6 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.464928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 456/911] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:34.465986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c52ca-4314-499e-b6d4-7b1415c904c6 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.475637 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32f7b49-fa91-4675-9723-997804d5343b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.476320 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f7b49-fa91-4675-9723-997804d5343b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.477212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f7b49-fa91-4675-9723-997804d5343b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.477684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32f7b49-fa91-4675-9723-997804d5343b None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.479092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f7b49-fa91-4675-9723-997804d5343b None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:34.479506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f7b49-fa91-4675-9723-997804d5343b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.483216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32f7b49-fa91-4675-9723-997804d5343b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.489694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 456/912] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:34.490810 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f28680-9428-4c8a-8c3d-9b02714deb78 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.491085 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f28680-9428-4c8a-8c3d-9b02714deb78 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.491352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f28680-9428-4c8a-8c3d-9b02714deb78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.513577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e3f28680-9428-4c8a-8c3d-9b02714deb78 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:34.515559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e3f28680-9428-4c8a-8c3d-9b02714deb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:34.593282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 457/913] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:34.595036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f28680-9428-4c8a-8c3d-9b02714deb78 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.628552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:34.631944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c52ca-4314-499e-b6d4-7b1415c904c6 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.659230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:34.691324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155d32b-47b0-4a2f-baf5-d16ddfcb5f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.691966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155d32b-47b0-4a2f-baf5-d16ddfcb5f4a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.692329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155d32b-47b0-4a2f-baf5-d16ddfcb5f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.692904 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f155d32b-47b0-4a2f-baf5-d16ddfcb5f4a None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.693521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155d32b-47b0-4a2f-baf5-d16ddfcb5f4a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:34.693989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155d32b-47b0-4a2f-baf5-d16ddfcb5f4a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.695689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f155d32b-47b0-4a2f-baf5-d16ddfcb5f4a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.718103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 457/914] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:34.719273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155d32b-47b0-4a2f-baf5-d16ddfcb5f4a None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.738404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f28680-9428-4c8a-8c3d-9b02714deb78 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.786563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c332a9-f72b-4e3d-8e33-aa4b5b80f104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.787549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c332a9-f72b-4e3d-8e33-aa4b5b80f104 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.788074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c332a9-f72b-4e3d-8e33-aa4b5b80f104 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.788519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c332a9-f72b-4e3d-8e33-aa4b5b80f104 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.789366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c332a9-f72b-4e3d-8e33-aa4b5b80f104 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:34.789898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c332a9-f72b-4e3d-8e33-aa4b5b80f104 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.791542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c332a9-f72b-4e3d-8e33-aa4b5b80f104 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.802086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 458/915] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:34.803273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c332a9-f72b-4e3d-8e33-aa4b5b80f104 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.830882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f155d32b-47b0-4a2f-baf5-d16ddfcb5f4a None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.867788 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1ddac-31ee-4446-88bb-9322829c2d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.868569 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1ddac-31ee-4446-88bb-9322829c2d22 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.868837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1ddac-31ee-4446-88bb-9322829c2d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.869113 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef1ddac-31ee-4446-88bb-9322829c2d22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.869871 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1ddac-31ee-4446-88bb-9322829c2d22 None admin] RBAC: Adding query filter params (role.id=f523dfe9fc8a4caba222da4603a476ef, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=773fb77106de4530a089e7abca48e333) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:34.870284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1ddac-31ee-4446-88bb-9322829c2d22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.872091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef1ddac-31ee-4446-88bb-9322829c2d22 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.878839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 458/916] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:34 2022] GET /identity/v3/role_assignments?user.id=773fb77106de4530a089e7abca48e333&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=f523dfe9fc8a4caba222da4603a476ef => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:34.879750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1ddac-31ee-4446-88bb-9322829c2d22 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:34.899197 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:34.916851 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c332a9-f72b-4e3d-8e33-aa4b5b80f104 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:34.929231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:34.963527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886aef4a-68c5-4183-a2e5-60f3403630aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:34.964249 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aef4a-68c5-4183-a2e5-60f3403630aa None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:34.964577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aef4a-68c5-4183-a2e5-60f3403630aa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:34.964847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886aef4a-68c5-4183-a2e5-60f3403630aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:34.965541 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886aef4a-68c5-4183-a2e5-60f3403630aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:34.967005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886aef4a-68c5-4183-a2e5-60f3403630aa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:34.998977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 459/917] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:34 2022] POST /identity/v3/endpoints => generated 347 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:35.014273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef1ddac-31ee-4446-88bb-9322829c2d22 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.023213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74730fd7-5b4b-4be0-8770-bd8c396c5709 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.023487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74730fd7-5b4b-4be0-8770-bd8c396c5709 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.023760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74730fd7-5b4b-4be0-8770-bd8c396c5709 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.025541 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 460/918] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:35.032599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ba472-d169-4bda-80b0-e2b0ca094bcc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.032880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ba472-d169-4bda-80b0-e2b0ca094bcc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.033203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3ba472-d169-4bda-80b0-e2b0ca094bcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.052930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8e3ba472-d169-4bda-80b0-e2b0ca094bcc None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:35.054148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8e3ba472-d169-4bda-80b0-e2b0ca094bcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:35.074392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61819b8-5d72-4532-8296-4950b809790b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.075121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61819b8-5d72-4532-8296-4950b809790b None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.075574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61819b8-5d72-4532-8296-4950b809790b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.075851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61819b8-5d72-4532-8296-4950b809790b None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.076865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61819b8-5d72-4532-8296-4950b809790b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.078394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61819b8-5d72-4532-8296-4950b809790b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.100867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 459/919] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:53:34 2022] POST /identity/v3/services => generated 241 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:35.153303 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 461/920] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:35.421318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61819b8-5d72-4532-8296-4950b809790b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.518279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:35.526661 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61819b8-5d72-4532-8296-4950b809790b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.562554 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552d0c-1fc2-4b05-bfbc-2dccd79391f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.563230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552d0c-1fc2-4b05-bfbc-2dccd79391f2 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.563507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552d0c-1fc2-4b05-bfbc-2dccd79391f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.563777 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15552d0c-1fc2-4b05-bfbc-2dccd79391f2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.564362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15552d0c-1fc2-4b05-bfbc-2dccd79391f2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.565773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15552d0c-1fc2-4b05-bfbc-2dccd79391f2 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-15552d0c-1fc2-4b05-bfbc-2dccd79391f2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:35.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:35.576160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:35.577060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 460/921] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:35.582550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ba472-d169-4bda-80b0-e2b0ca094bcc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.659731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:35.693015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3ba472-d169-4bda-80b0-e2b0ca094bcc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.728632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dbbb1-8dcf-4dbe-b52e-ad82f4fec8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.729618 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dbbb1-8dcf-4dbe-b52e-ad82f4fec8c2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.730139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dbbb1-8dcf-4dbe-b52e-ad82f4fec8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.730590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75dbbb1-8dcf-4dbe-b52e-ad82f4fec8c2 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.731437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dbbb1-8dcf-4dbe-b52e-ad82f4fec8c2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:35.731926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dbbb1-8dcf-4dbe-b52e-ad82f4fec8c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.733468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75dbbb1-8dcf-4dbe-b52e-ad82f4fec8c2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.738837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 462/922] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:35.744778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552d0c-1fc2-4b05-bfbc-2dccd79391f2 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.849085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15552d0c-1fc2-4b05-bfbc-2dccd79391f2 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:35.881807 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c41916-f806-42b0-a8dd-1be1121a5f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:35.882415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41916-f806-42b0-a8dd-1be1121a5f3c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:35.882689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41916-f806-42b0-a8dd-1be1121a5f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:35.882987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c41916-f806-42b0-a8dd-1be1121a5f3c None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:35.883620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c41916-f806-42b0-a8dd-1be1121a5f3c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:35.883920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c41916-f806-42b0-a8dd-1be1121a5f3c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:35.885355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c41916-f806-42b0-a8dd-1be1121a5f3c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:35.890498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 461/923] 10.222.0.59 () {56 vars in 1114 bytes} [Thu Aug 18 20:53:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:35.896572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dbbb1-8dcf-4dbe-b52e-ad82f4fec8c2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:35.999240 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75dbbb1-8dcf-4dbe-b52e-ad82f4fec8c2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:36.035324 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b5eeb-dc31-47d0-995c-23ba97d5b841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:36.035943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5eeb-dc31-47d0-995c-23ba97d5b841 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.036218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5eeb-dc31-47d0-995c-23ba97d5b841 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.036490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b5eeb-dc31-47d0-995c-23ba97d5b841 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.037177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b5eeb-dc31-47d0-995c-23ba97d5b841 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:36.038563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b5eeb-dc31-47d0-995c-23ba97d5b841 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:36.043906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:36.064894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 463/924] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:36.883361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e8be-a742-415e-b03a-cd19654f58b1 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.883901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e8be-a742-415e-b03a-cd19654f58b1 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.883901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6194e8be-a742-415e-b03a-cd19654f58b1 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.885564 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 462/925] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:36.891009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f1a8f-1795-43a8-b688-e66e8cf2dc36 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:36.891449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f1a8f-1795-43a8-b688-e66e8cf2dc36 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:36.891540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f1a8f-1795-43a8-b688-e66e8cf2dc36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:36.910923 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b94f1a8f-1795-43a8-b688-e66e8cf2dc36 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:36.912120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b94f1a8f-1795-43a8-b688-e66e8cf2dc36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:36.994961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 464/926] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:36 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:37.044758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a78a70-72d9-4ab7-bba5-6c6f4e427873 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.044949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a78a70-72d9-4ab7-bba5-6c6f4e427873 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.045220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a78a70-72d9-4ab7-bba5-6c6f4e427873 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.046707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 463/927] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:37.050674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e08113-0b01-4ede-9773-6adaf548a8cf None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.051068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e08113-0b01-4ede-9773-6adaf548a8cf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.051346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e08113-0b01-4ede-9773-6adaf548a8cf None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.052463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831fdf7-e2f7-4cae-8cc8-e1309e3f1ba3 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.052920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 465/928] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:37.053150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831fdf7-e2f7-4cae-8cc8-e1309e3f1ba3 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.053616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831fdf7-e2f7-4cae-8cc8-e1309e3f1ba3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.057794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae5b62-2d98-4981-8596-eaba6b08f91c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.058081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae5b62-2d98-4981-8596-eaba6b08f91c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.058360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae5b62-2d98-4981-8596-eaba6b08f91c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.072924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d831fdf7-e2f7-4cae-8cc8-e1309e3f1ba3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:37.074704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d831fdf7-e2f7-4cae-8cc8-e1309e3f1ba3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:37.077016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1bae5b62-2d98-4981-8596-eaba6b08f91c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:37.078308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1bae5b62-2d98-4981-8596-eaba6b08f91c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:37.100225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:37.160479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 464/929] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:37.174794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 466/930] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:37 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:37.275722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831fdf7-e2f7-4cae-8cc8-e1309e3f1ba3 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.379272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831fdf7-e2f7-4cae-8cc8-e1309e3f1ba3 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.419322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdf961-0a2f-4c76-9a9e-abbb10612f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.420327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdf961-0a2f-4c76-9a9e-abbb10612f98 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.420814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdf961-0a2f-4c76-9a9e-abbb10612f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.421321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bdf961-0a2f-4c76-9a9e-abbb10612f98 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.426121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae5b62-2d98-4981-8596-eaba6b08f91c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.434100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bdf961-0a2f-4c76-9a9e-abbb10612f98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-a9bdf961-0a2f-4c76-9a9e-abbb10612f98 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:37.440536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:37.441496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:37.442351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:37.443679 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 465/931] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:37.447442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdf961-0a2f-4c76-9a9e-abbb10612f98 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.466312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:37.491425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:37.549122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae5b62-2d98-4981-8596-eaba6b08f91c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.563895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bdf961-0a2f-4c76-9a9e-abbb10612f98 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.595368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd3be0-f146-4b42-b186-73ae32af1e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.596002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd3be0-f146-4b42-b186-73ae32af1e15 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.596272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd3be0-f146-4b42-b186-73ae32af1e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.596542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dd3be0-f146-4b42-b186-73ae32af1e15 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.597116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd3be0-f146-4b42-b186-73ae32af1e15 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.598486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dd3be0-f146-4b42-b186-73ae32af1e15 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.601125 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c9bfa-859a-4399-8b19-8ed0ce305650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.601760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c9bfa-859a-4399-8b19-8ed0ce305650 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.602034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c9bfa-859a-4399-8b19-8ed0ce305650 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.602294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c9bfa-859a-4399-8b19-8ed0ce305650 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.603780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c9bfa-859a-4399-8b19-8ed0ce305650 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:37.603780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c9bfa-859a-4399-8b19-8ed0ce305650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.605271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c9bfa-859a-4399-8b19-8ed0ce305650 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-19dd3be0-f146-4b42-b186-73ae32af1e15 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:37.607386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:37.608406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:37.609254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:37.613496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 467/932] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:37.614189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd3be0-f146-4b42-b186-73ae32af1e15 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.617262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 466/933] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:37.618283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c9bfa-859a-4399-8b19-8ed0ce305650 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.699715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:37.726606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c9bfa-859a-4399-8b19-8ed0ce305650 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.727266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dd3be0-f146-4b42-b186-73ae32af1e15 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.738884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:37.765644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba4f66-40b7-41f9-9572-51bf9eb6121a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.766308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba4f66-40b7-41f9-9572-51bf9eb6121a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.766585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba4f66-40b7-41f9-9572-51bf9eb6121a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.766889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ba4f66-40b7-41f9-9572-51bf9eb6121a None admin] PATH_INFO: `/v3/services/compute` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.767479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba4f66-40b7-41f9-9572-51bf9eb6121a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.768618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27dc38-2315-4748-b7d0-a73f75ae914a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.768860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ba4f66-40b7-41f9-9572-51bf9eb6121a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.769628 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27dc38-2315-4748-b7d0-a73f75ae914a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.769903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27dc38-2315-4748-b7d0-a73f75ae914a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.770175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27dc38-2315-4748-b7d0-a73f75ae914a None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.771183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27dc38-2315-4748-b7d0-a73f75ae914a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:37.771485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27dc38-2315-4748-b7d0-a73f75ae914a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.772860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab27dc38-2315-4748-b7d0-a73f75ae914a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.778454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 467/934] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a5ba4f66-40b7-41f9-9572-51bf9eb6121a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:37.781913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:37.783007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:37.783840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 468/935] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:37.784658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27dc38-2315-4748-b7d0-a73f75ae914a None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.786283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba4f66-40b7-41f9-9572-51bf9eb6121a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.893719 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab27dc38-2315-4748-b7d0-a73f75ae914a None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.894255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ba4f66-40b7-41f9-9572-51bf9eb6121a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:37.930711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7ab23-d7b0-4f76-a5ea-ac5960f6bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.931360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7ab23-d7b0-4f76-a5ea-ac5960f6bdcc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.931643 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7ab23-d7b0-4f76-a5ea-ac5960f6bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.931936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7ab23-d7b0-4f76-a5ea-ac5960f6bdcc None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.932960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7ab23-d7b0-4f76-a5ea-ac5960f6bdcc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:37.933148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c350eb-d77a-4191-922f-a3db6470d950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:37.933287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7ab23-d7b0-4f76-a5ea-ac5960f6bdcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.933773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c350eb-d77a-4191-922f-a3db6470d950 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:37.934049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c350eb-d77a-4191-922f-a3db6470d950 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:37.934315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c350eb-d77a-4191-922f-a3db6470d950 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:37.934632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7ab23-d7b0-4f76-a5ea-ac5960f6bdcc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.940049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 469/936] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:37.940655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7ab23-d7b0-4f76-a5ea-ac5960f6bdcc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.946549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:37.951746 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c350eb-d77a-4191-922f-a3db6470d950 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:37.953626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c350eb-d77a-4191-922f-a3db6470d950 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-21c350eb-d77a-4191-922f-a3db6470d950 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:37.968326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:37.969299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:37.970216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:37.970216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:37.970216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:37.970216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 468/937] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:37.971111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c350eb-d77a-4191-922f-a3db6470d950 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:37.986660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:38.060168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7ab23-d7b0-4f76-a5ea-ac5960f6bdcc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.085945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c350eb-d77a-4191-922f-a3db6470d950 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.095362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd326a7-1f09-4d4e-afb9-9fa7b9100811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.095978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd326a7-1f09-4d4e-afb9-9fa7b9100811 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.096255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd326a7-1f09-4d4e-afb9-9fa7b9100811 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.096530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd326a7-1f09-4d4e-afb9-9fa7b9100811 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.097188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd326a7-1f09-4d4e-afb9-9fa7b9100811 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:38.097483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd326a7-1f09-4d4e-afb9-9fa7b9100811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.098884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd326a7-1f09-4d4e-afb9-9fa7b9100811 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.107206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 470/938] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:38.107206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd326a7-1f09-4d4e-afb9-9fa7b9100811 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.121360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfdcb77e-ae37-4a36-bdc5-98b08c5bebcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.121975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb77e-ae37-4a36-bdc5-98b08c5bebcb None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.122247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb77e-ae37-4a36-bdc5-98b08c5bebcb None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.122516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdcb77e-ae37-4a36-bdc5-98b08c5bebcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.123248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcb77e-ae37-4a36-bdc5-98b08c5bebcb None admin] RBAC: Adding query filter params (interface=public, service_id=9df0a588413d4736a555e566959950c1, region_id=RegionOne) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:38.123551 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcb77e-ae37-4a36-bdc5-98b08c5bebcb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.124927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfdcb77e-ae37-4a36-bdc5-98b08c5bebcb None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.129985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 469/939] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Aug 18 20:53:37 2022] GET /identity/v3/endpoints?service_id=9df0a588413d4736a555e566959950c1&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:38.131203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c7954-690f-424c-86a4-469e7216e35c None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.131492 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c7954-690f-424c-86a4-469e7216e35c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.131770 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453c7954-690f-424c-86a4-469e7216e35c None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.133154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 470/940] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:38.133844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c7954-690f-424c-86a4-469e7216e35c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.195757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:38.215104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd326a7-1f09-4d4e-afb9-9fa7b9100811 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.216542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:38.245613 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453c7954-690f-424c-86a4-469e7216e35c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.252788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93af0-27d1-4663-80a2-dbfe5ad442d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.253437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93af0-27d1-4663-80a2-dbfe5ad442d7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.253710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93af0-27d1-4663-80a2-dbfe5ad442d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.253977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd93af0-27d1-4663-80a2-dbfe5ad442d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.254632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd93af0-27d1-4663-80a2-dbfe5ad442d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:38.254959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd93af0-27d1-4663-80a2-dbfe5ad442d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.256395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd93af0-27d1-4663-80a2-dbfe5ad442d7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.268157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 471/941] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:38.269193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93af0-27d1-4663-80a2-dbfe5ad442d7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.283969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a1397-090a-4ee3-83ca-1bd3ca7feed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.284701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a1397-090a-4ee3-83ca-1bd3ca7feed9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.284899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a1397-090a-4ee3-83ca-1bd3ca7feed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.285142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a1397-090a-4ee3-83ca-1bd3ca7feed9 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.285808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a1397-090a-4ee3-83ca-1bd3ca7feed9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:38.286103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a1397-090a-4ee3-83ca-1bd3ca7feed9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.287508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a1397-090a-4ee3-83ca-1bd3ca7feed9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.292138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 471/942] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:38 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:38.293312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207075-e9ff-4698-8eb0-65079059f730 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.293596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207075-e9ff-4698-8eb0-65079059f730 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.293866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e207075-e9ff-4698-8eb0-65079059f730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.314115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-2e207075-e9ff-4698-8eb0-65079059f730 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:38.315416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2e207075-e9ff-4698-8eb0-65079059f730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:38.384163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd93af0-27d1-4663-80a2-dbfe5ad442d7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.395902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 472/943] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:38.396878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e207075-e9ff-4698-8eb0-65079059f730 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.436560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215650-9d32-4315-8301-30e399d8e0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.437181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215650-9d32-4315-8301-30e399d8e0d2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.437453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215650-9d32-4315-8301-30e399d8e0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.437722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd215650-9d32-4315-8301-30e399d8e0d2 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.438340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215650-9d32-4315-8301-30e399d8e0d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.440377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd215650-9d32-4315-8301-30e399d8e0d2 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.450716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 472/944] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Aug 18 20:53:38 2022] GET /identity/v3/services => generated 1497 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:38.457253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:38.522289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e207075-e9ff-4698-8eb0-65079059f730 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.562816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb537ca-6f9b-4506-986e-ada820768dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.563966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb537ca-6f9b-4506-986e-ada820768dff None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.564468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb537ca-6f9b-4506-986e-ada820768dff None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.564971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb537ca-6f9b-4506-986e-ada820768dff None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.573951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb537ca-6f9b-4506-986e-ada820768dff None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.576017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb537ca-6f9b-4506-986e-ada820768dff None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-8bb537ca-6f9b-4506-986e-ada820768dff None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:38.590041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:38.591144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:38.592159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:38.592159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:38.592159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:38.592159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:38.592159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:38.592159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:38.592159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:38.592159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:38.592159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:38.592159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:38.598911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 473/945] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Aug 18 20:53:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:38.601414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215650-9d32-4315-8301-30e399d8e0d2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.633761 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:38.669697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb537ca-6f9b-4506-986e-ada820768dff None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.726703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd215650-9d32-4315-8301-30e399d8e0d2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.764280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63b6fa-5b5f-401b-a244-06b4225d4339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.765014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63b6fa-5b5f-401b-a244-06b4225d4339 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.765356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63b6fa-5b5f-401b-a244-06b4225d4339 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.765632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c63b6fa-5b5f-401b-a244-06b4225d4339 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.766369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63b6fa-5b5f-401b-a244-06b4225d4339 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:38.766675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63b6fa-5b5f-401b-a244-06b4225d4339 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.768364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c63b6fa-5b5f-401b-a244-06b4225d4339 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.788544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 473/946] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Aug 18 20:53:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:38.794701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63b6fa-5b5f-401b-a244-06b4225d4339 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.795150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb537ca-6f9b-4506-986e-ada820768dff None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.805678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:38.835396 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.836189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.836571 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.836943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.837697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.840168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.843408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: WARNING keystone.server.flask.common [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 20:53:38.866733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.sql.core [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:53:38.866733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 20:53:38.866733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [parameters: {'id': 'eac8748db66b424fa81ca8418edb3841', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 20:53:38.866733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81587) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eac8748db66b424fa81ca8418edb3841.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eac8748db66b424fa81ca8418edb3841. Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:53:38.875515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application result.read() Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 18 20:53:38.877167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application yield resource Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise self.value Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application session.commit() Aug 18 20:53:38.878796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:53:38.879733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:53:38.880776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application result.read() Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:53:38.881596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [parameters: {'id': 'eac8748db66b424fa81ca8418edb3841', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:38.882463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:38.883314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:38.892169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:38.892169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 18 20:53:38.892169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 18 20:53:38.892169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:38.892169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:38.892169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 18 20:53:38.892169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 18 20:53:38.892169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eac8748db66b424fa81ca8418edb3841. Aug 18 20:53:38.892169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:38.892169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 474/947] 10.222.0.59 () {60 vars in 1140 bytes} [Thu Aug 18 20:53:38 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:38.892786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:38.896290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:38.907722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c63b6fa-5b5f-401b-a244-06b4225d4339 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:38.946052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e672bdc-a885-4d59-a496-b8a13934d4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:38.946716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e672bdc-a885-4d59-a496-b8a13934d4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:38.947019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e672bdc-a885-4d59-a496-b8a13934d4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:38.947292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e672bdc-a885-4d59-a496-b8a13934d4a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:38.958759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e672bdc-a885-4d59-a496-b8a13934d4a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:38.960424 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e672bdc-a885-4d59-a496-b8a13934d4a1 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8e672bdc-a885-4d59-a496-b8a13934d4a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:38.976926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:38.977944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:38.978888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:38.978888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:38.978888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:38.978888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 474/948] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:38.987796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e672bdc-a885-4d59-a496-b8a13934d4a1 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.042327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ca5f09-d94e-47e7-bb65-925f1ebd216d None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.079796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1038567-4982-4356-9156-e4e58d5f9100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.080799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1038567-4982-4356-9156-e4e58d5f9100 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.081356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1038567-4982-4356-9156-e4e58d5f9100 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.081825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1038567-4982-4356-9156-e4e58d5f9100 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.089523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1038567-4982-4356-9156-e4e58d5f9100 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.091627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1038567-4982-4356-9156-e4e58d5f9100 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-a1038567-4982-4356-9156-e4e58d5f9100 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:39.103751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:39.104811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:39.105875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:39.105875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:39.105875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:39.105875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:39.105875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:39.105875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:39.105875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:39.105875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:39.106336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e672bdc-a885-4d59-a496-b8a13934d4a1 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.108438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 475/949] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:39.114427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1038567-4982-4356-9156-e4e58d5f9100 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.144140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:39.149501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f32a4f-a399-48fd-a0c2-fbfbbc37ef5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.150122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f32a4f-a399-48fd-a0c2-fbfbbc37ef5a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.150401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f32a4f-a399-48fd-a0c2-fbfbbc37ef5a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.150677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f32a4f-a399-48fd-a0c2-fbfbbc37ef5a None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.152606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f32a4f-a399-48fd-a0c2-fbfbbc37ef5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:39.152930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f32a4f-a399-48fd-a0c2-fbfbbc37ef5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.155341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f32a4f-a399-48fd-a0c2-fbfbbc37ef5a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.157975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:39.175771 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 475/950] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:39.176814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f32a4f-a399-48fd-a0c2-fbfbbc37ef5a None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.235114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1038567-4982-4356-9156-e4e58d5f9100 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.272729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6081e-a173-4c5d-8295-181a109180cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.273692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6081e-a173-4c5d-8295-181a109180cd None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.274148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6081e-a173-4c5d-8295-181a109180cd None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.274687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d6081e-a173-4c5d-8295-181a109180cd None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.275564 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6081e-a173-4c5d-8295-181a109180cd None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:39.276041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6081e-a173-4c5d-8295-181a109180cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.277981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d6081e-a173-4c5d-8295-181a109180cd None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.287554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f32a4f-a399-48fd-a0c2-fbfbbc37ef5a None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.300352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 476/951] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:39 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:39.331271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55fda6-4809-4729-be8e-1e22ba265690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.332346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55fda6-4809-4729-be8e-1e22ba265690 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.332840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55fda6-4809-4729-be8e-1e22ba265690 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.333389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba55fda6-4809-4729-be8e-1e22ba265690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.341973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55fda6-4809-4729-be8e-1e22ba265690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.343841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba55fda6-4809-4729-be8e-1e22ba265690 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ba55fda6-4809-4729-be8e-1e22ba265690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:39.359220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:39.360209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:39.361104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:39.361104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:39.361104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:39.361104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:39.361104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:39.361104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:39.361104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:39.361104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:39.363753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 476/952] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:39.370215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6081e-a173-4c5d-8295-181a109180cd None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.467027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:39.485884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d6081e-a173-4c5d-8295-181a109180cd None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.523774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bbb9b2-1951-4315-b12d-ecb56f1ffea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.524397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbb9b2-1951-4315-b12d-ecb56f1ffea9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.524676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbb9b2-1951-4315-b12d-ecb56f1ffea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.524946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bbb9b2-1951-4315-b12d-ecb56f1ffea9 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.525654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbb9b2-1951-4315-b12d-ecb56f1ffea9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:39.525959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbb9b2-1951-4315-b12d-ecb56f1ffea9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.527548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bbb9b2-1951-4315-b12d-ecb56f1ffea9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.540861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 477/953] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:39.547066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55fda6-4809-4729-be8e-1e22ba265690 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:39.609054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:39.656509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba55fda6-4809-4729-be8e-1e22ba265690 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:39.692512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29482be8-fdc0-44e5-9274-e0167212d514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:39.693177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482be8-fdc0-44e5-9274-e0167212d514 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:39.693451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482be8-fdc0-44e5-9274-e0167212d514 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:39.693725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482be8-fdc0-44e5-9274-e0167212d514 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/773fb77106de4530a089e7abca48e333/roles/f523dfe9fc8a4caba222da4603a476ef` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:39.696019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29482be8-fdc0-44e5-9274-e0167212d514 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=773fb77106de4530a089e7abca48e333, role_id=f523dfe9fc8a4caba222da4603a476ef)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:39.697552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29482be8-fdc0-44e5-9274-e0167212d514 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:39.714511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 477/954] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:39 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/773fb77106de4530a089e7abca48e333/roles/f523dfe9fc8a4caba222da4603a476ef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:40.330560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f43e0-4328-41f4-87d5-11b23d3a7ae0 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.331116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f43e0-4328-41f4-87d5-11b23d3a7ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.331420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2f43e0-4328-41f4-87d5-11b23d3a7ae0 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.341869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 478/955] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:40 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:40.347716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fe44c-12c1-4475-be8f-f889711a9f68 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.348194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fe44c-12c1-4475-be8f-f889711a9f68 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.348275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4fe44c-12c1-4475-be8f-f889711a9f68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.367753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6b4fe44c-12c1-4475-be8f-f889711a9f68 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:40.368962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6b4fe44c-12c1-4475-be8f-f889711a9f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:40.427371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a25ef-04e5-434b-a917-1cec2da0f142 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.427371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a25ef-04e5-434b-a917-1cec2da0f142 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.427371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a25ef-04e5-434b-a917-1cec2da0f142 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.429089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 479/956] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:40.439864 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14409cc6-5e99-43be-a6de-12c8d10fcede None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.440267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14409cc6-5e99-43be-a6de-12c8d10fcede None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.440610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14409cc6-5e99-43be-a6de-12c8d10fcede None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.445573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 478/957] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:40.460901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-14409cc6-5e99-43be-a6de-12c8d10fcede None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:40.462653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-14409cc6-5e99-43be-a6de-12c8d10fcede None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:40.532060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 480/958] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:40.713948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fe44c-12c1-4475-be8f-f889711a9f68 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.763616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:40.816960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14409cc6-5e99-43be-a6de-12c8d10fcede None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:40.825658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4fe44c-12c1-4475-be8f-f889711a9f68 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.871722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd5024-2650-4dd4-9864-cab62628af1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.872721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd5024-2650-4dd4-9864-cab62628af1c None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.873003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd5024-2650-4dd4-9864-cab62628af1c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.873272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cd5024-2650-4dd4-9864-cab62628af1c None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.873925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd5024-2650-4dd4-9864-cab62628af1c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.876127 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cd5024-2650-4dd4-9864-cab62628af1c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:40.898532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 479/959] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:53:40 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:40.904553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:40.937372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14409cc6-5e99-43be-a6de-12c8d10fcede None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:40.987291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc5867-1758-48bf-b9dc-5c4a313bbd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:40.987946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc5867-1758-48bf-b9dc-5c4a313bbd5b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:40.988272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc5867-1758-48bf-b9dc-5c4a313bbd5b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:40.988655 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bc5867-1758-48bf-b9dc-5c4a313bbd5b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:40.989252 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc5867-1758-48bf-b9dc-5c4a313bbd5b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:40.990918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bc5867-1758-48bf-b9dc-5c4a313bbd5b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-90bc5867-1758-48bf-b9dc-5c4a313bbd5b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:41.001638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:41.002837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:41.003759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 481/960] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:40 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:41.016061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd5024-2650-4dd4-9864-cab62628af1c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.136693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cd5024-2650-4dd4-9864-cab62628af1c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.144596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:41.177741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ad03a-c51f-49b1-a6e5-1ca674155fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.178726 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ad03a-c51f-49b1-a6e5-1ca674155fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.179210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ad03a-c51f-49b1-a6e5-1ca674155fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.179659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72ad03a-c51f-49b1-a6e5-1ca674155fe8 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.180569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ad03a-c51f-49b1-a6e5-1ca674155fe8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:41.181048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ad03a-c51f-49b1-a6e5-1ca674155fe8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.182719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72ad03a-c51f-49b1-a6e5-1ca674155fe8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.189048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 480/961] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Aug 18 20:53:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:41.194809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc5867-1758-48bf-b9dc-5c4a313bbd5b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.309836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bc5867-1758-48bf-b9dc-5c4a313bbd5b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.345788 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b662aacd-4f61-41c4-9757-7fded9fc38b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.347213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662aacd-4f61-41c4-9757-7fded9fc38b9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.347724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662aacd-4f61-41c4-9757-7fded9fc38b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.348189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b662aacd-4f61-41c4-9757-7fded9fc38b9 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.349017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662aacd-4f61-41c4-9757-7fded9fc38b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:41.349505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662aacd-4f61-41c4-9757-7fded9fc38b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.351081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b662aacd-4f61-41c4-9757-7fded9fc38b9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.352614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:41.358550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 482/962] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Aug 18 20:53:41 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:41.363985 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ad03a-c51f-49b1-a6e5-1ca674155fe8 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.432188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1eec-3999-4eac-bdb7-aab1650ae942 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.432591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1eec-3999-4eac-bdb7-aab1650ae942 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.433511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff1eec-3999-4eac-bdb7-aab1650ae942 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.434922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 483/963] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:41.440079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225540f-269f-4f32-876b-36d8fc8c90c5 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.440425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225540f-269f-4f32-876b-36d8fc8c90c5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.440681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2225540f-269f-4f32-876b-36d8fc8c90c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.460118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-2225540f-269f-4f32-876b-36d8fc8c90c5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:41.461767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2225540f-269f-4f32-876b-36d8fc8c90c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.477816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72ad03a-c51f-49b1-a6e5-1ca674155fe8 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.512902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcabd80-3c7d-4363-ac7d-fac8026087fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.513515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcabd80-3c7d-4363-ac7d-fac8026087fb None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.513792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcabd80-3c7d-4363-ac7d-fac8026087fb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.514060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcabd80-3c7d-4363-ac7d-fac8026087fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.514733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcabd80-3c7d-4363-ac7d-fac8026087fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.516140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcabd80-3c7d-4363-ac7d-fac8026087fb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.538641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 481/964] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:41.546446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 484/965] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:41.706756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfbf66-c362-4d7b-a506-f6ad0b158ca1 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.707026 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfbf66-c362-4d7b-a506-f6ad0b158ca1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.707263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bfbf66-c362-4d7b-a506-f6ad0b158ca1 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.708865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 482/966] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:41.714684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f587-5902-4c3b-b459-e7a0f05074ed None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.715015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f587-5902-4c3b-b459-e7a0f05074ed None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.715290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7349f587-5902-4c3b-b459-e7a0f05074ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.735002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7349f587-5902-4c3b-b459-e7a0f05074ed None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:41.736254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7349f587-5902-4c3b-b459-e7a0f05074ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:41.814603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 485/967] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:41.848266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfbf66-c362-4d7b-a506-f6ad0b158ca1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:41.878756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:41.956469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bfbf66-c362-4d7b-a506-f6ad0b158ca1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:41.991074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:41.991694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:41.991968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:41.992237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:41.992875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:41.994328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:41.997321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WARNING keystone.server.flask.common [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 18 20:53:42.012074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.sql.core [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:53:42.012074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 20:53:42.012074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [parameters: {'user_id': '460cacadccec4dfaa3695d3c269c3374', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 20:53:42.012074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81586) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application result.read() Aug 18 20:53:42.029742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:53:42.030681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application yield resource Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application next(self.gen) Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.session.rollback() Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.force_reraise() Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise self.value Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application session.commit() Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 18 20:53:42.032147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._prepare_impl() Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.session.flush() Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._flush(objects) Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application compat.raise_( Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application flush_context.execute() Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rec.execute(self) Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 18 20:53:42.034023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 18 20:53:42.036203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application result = self._query(query) Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application conn.query(q) Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application result.read() Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 18 20:53:42.040625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [parameters: {'user_id': '460cacadccec4dfaa3695d3c269c3374', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:42.042754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 18 20:53:42.044714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 18 20:53:42.051220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 18 20:53:42.051220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 18 20:53:42.051220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 18 20:53:42.051220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 18 20:53:42.051220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 18 20:53:42.051220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:42.051220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 483/968] 10.222.0.59 () {60 vars in 1131 bytes} [Thu Aug 18 20:53:41 2022] POST /identity/v3/users => generated 160 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:42.052218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f587-5902-4c3b-b459-e7a0f05074ed None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.094799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.097861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:42.158523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7349f587-5902-4c3b-b459-e7a0f05074ed None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.195641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:42.201445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62698807-8b6e-4af5-bf02-7d2a68844e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.202413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62698807-8b6e-4af5-bf02-7d2a68844e8f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.202700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62698807-8b6e-4af5-bf02-7d2a68844e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.203014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62698807-8b6e-4af5-bf02-7d2a68844e8f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.211446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62698807-8b6e-4af5-bf02-7d2a68844e8f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.213272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62698807-8b6e-4af5-bf02-7d2a68844e8f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.215128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895e867-646b-4cad-83ed-d54ba011ba02 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-62698807-8b6e-4af5-bf02-7d2a68844e8f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:42.226470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:42.227553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:42.228496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:42.228496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:42.228496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:42.228496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:42.228496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:42.228496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:42.228496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:42.228496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:42.228496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 18 20:53:42.228496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:42.230920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 486/969] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/users/cinder => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:42.236561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62698807-8b6e-4af5-bf02-7d2a68844e8f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.256705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2cfc9-f39a-4509-ba1a-18fcee828df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.257593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cfc9-f39a-4509-ba1a-18fcee828df7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.258050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cfc9-f39a-4509-ba1a-18fcee828df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.258559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2cfc9-f39a-4509-ba1a-18fcee828df7 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.270121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2cfc9-f39a-4509-ba1a-18fcee828df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-29b2cfc9-f39a-4509-ba1a-18fcee828df7 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:42.276874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:42.277844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:42.278692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:42.286306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 484/970] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:42.287504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2cfc9-f39a-4509-ba1a-18fcee828df7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.358018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62698807-8b6e-4af5-bf02-7d2a68844e8f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.375912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:42.400380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9aa23-f895-4616-ab3b-10b2b3be86f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.401329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9aa23-f895-4616-ab3b-10b2b3be86f1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.401837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9aa23-f895-4616-ab3b-10b2b3be86f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.401978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2cfc9-f39a-4509-ba1a-18fcee828df7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.402818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9aa23-f895-4616-ab3b-10b2b3be86f1 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.403815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9aa23-f895-4616-ab3b-10b2b3be86f1 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:42.404395 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9aa23-f895-4616-ab3b-10b2b3be86f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.406078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9aa23-f895-4616-ab3b-10b2b3be86f1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.438423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084d748-efce-49f5-b13e-bb2a357c4bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.439520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084d748-efce-49f5-b13e-bb2a357c4bbd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.440140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084d748-efce-49f5-b13e-bb2a357c4bbd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.440683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084d748-efce-49f5-b13e-bb2a357c4bbd None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.441561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084d748-efce-49f5-b13e-bb2a357c4bbd None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:42.442038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084d748-efce-49f5-b13e-bb2a357c4bbd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.443830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084d748-efce-49f5-b13e-bb2a357c4bbd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.450926 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 487/971] 10.222.0.59 () {56 vars in 1101 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:42.462123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 485/972] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:42.468812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9aa23-f895-4616-ab3b-10b2b3be86f1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.581704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9aa23-f895-4616-ab3b-10b2b3be86f1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.623429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687b4d7-0229-46b0-829d-e7084528bc09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.624440 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b4d7-0229-46b0-829d-e7084528bc09 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.624942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b4d7-0229-46b0-829d-e7084528bc09 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.625422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b687b4d7-0229-46b0-829d-e7084528bc09 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.638152 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687b4d7-0229-46b0-829d-e7084528bc09 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.640130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b687b4d7-0229-46b0-829d-e7084528bc09 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-b687b4d7-0229-46b0-829d-e7084528bc09 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:42.656644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:42.657762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:42.658669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:42.658669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:42.658669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:42.660456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 488/973] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:42.666497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084d748-efce-49f5-b13e-bb2a357c4bbd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.680489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:42.781642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084d748-efce-49f5-b13e-bb2a357c4bbd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.815598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41dc53-dc01-4070-aca7-8b45198ba5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.816203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41dc53-dc01-4070-aca7-8b45198ba5f8 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.816474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41dc53-dc01-4070-aca7-8b45198ba5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.816736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41dc53-dc01-4070-aca7-8b45198ba5f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.817397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41dc53-dc01-4070-aca7-8b45198ba5f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:42.817695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41dc53-dc01-4070-aca7-8b45198ba5f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.819088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41dc53-dc01-4070-aca7-8b45198ba5f8 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:42.831972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 486/974] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:42.837475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687b4d7-0229-46b0-829d-e7084528bc09 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:42.866006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:42.947671 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b687b4d7-0229-46b0-829d-e7084528bc09 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:42.981479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd3ef6-617f-459e-b82a-9b74f4a3b8e0 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.982113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd3ef6-617f-459e-b82a-9b74f4a3b8e0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.982382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd3ef6-617f-459e-b82a-9b74f4a3b8e0 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.982484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1584cf-8b2c-43a2-a1a2-e779936f36bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:42.983168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1584cf-8b2c-43a2-a1a2-e779936f36bd None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.983452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1584cf-8b2c-43a2-a1a2-e779936f36bd None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.983728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1584cf-8b2c-43a2-a1a2-e779936f36bd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.984133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 487/975] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:42.988909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553da6-814d-47cd-8a1f-099a4c018b2f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:42.989232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553da6-814d-47cd-8a1f-099a4c018b2f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:42.989454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58553da6-814d-47cd-8a1f-099a4c018b2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:42.992714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1584cf-8b2c-43a2-a1a2-e779936f36bd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:42.994300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1584cf-8b2c-43a2-a1a2-e779936f36bd None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-3d1584cf-8b2c-43a2-a1a2-e779936f36bd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:43.007689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:43.010076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:43.012321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:43.012321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:43.012321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:43.012321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:43.012321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:43.012321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:43.012321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:43.012321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:43.012321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 18 20:53:43.012321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:43.013651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-58553da6-814d-47cd-8a1f-099a4c018b2f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:43.013803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 489/976] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Aug 18 20:53:42 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:43.014087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-58553da6-814d-47cd-8a1f-099a4c018b2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:43.014594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1584cf-8b2c-43a2-a1a2-e779936f36bd None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.090678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:43.106798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 488/977] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:42 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:43.108847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:43.125335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1584cf-8b2c-43a2-a1a2-e779936f36bd None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.160679 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5504715-0413-4984-9a51-d89b15b59c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.161283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5504715-0413-4984-9a51-d89b15b59c03 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.161554 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5504715-0413-4984-9a51-d89b15b59c03 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.161819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5504715-0413-4984-9a51-d89b15b59c03 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.162547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5504715-0413-4984-9a51-d89b15b59c03 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:43.162873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5504715-0413-4984-9a51-d89b15b59c03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.164297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5504715-0413-4984-9a51-d89b15b59c03 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.186697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 490/978] 10.222.0.59 () {56 vars in 1149 bytes} [Thu Aug 18 20:53:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:43.188091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58553da6-814d-47cd-8a1f-099a4c018b2f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.290698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58553da6-814d-47cd-8a1f-099a4c018b2f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.325458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c25327e-687f-4465-b46e-f517e63ba239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.326063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25327e-687f-4465-b46e-f517e63ba239 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.326336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25327e-687f-4465-b46e-f517e63ba239 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.326598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c25327e-687f-4465-b46e-f517e63ba239 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.362525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5504715-0413-4984-9a51-d89b15b59c03 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.394208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:43.397364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25327e-687f-4465-b46e-f517e63ba239 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.398953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c25327e-687f-4465-b46e-f517e63ba239 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.466988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5504715-0413-4984-9a51-d89b15b59c03 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.499839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fed3bd-d0f9-45f8-95c9-fb1201ff032b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.500462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fed3bd-d0f9-45f8-95c9-fb1201ff032b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.500734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fed3bd-d0f9-45f8-95c9-fb1201ff032b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.500857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 489/979] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:43 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:53:43.501273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fed3bd-d0f9-45f8-95c9-fb1201ff032b None admin] PATH_INFO: `/v3/services/compute` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.501558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fed3bd-d0f9-45f8-95c9-fb1201ff032b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.502946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28fed3bd-d0f9-45f8-95c9-fb1201ff032b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.506692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf46b-6dac-4300-ae15-279d6a8fde71 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.507001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf46b-6dac-4300-ae15-279d6a8fde71 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.507274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabf46b-6dac-4300-ae15-279d6a8fde71 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.508543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 490/980] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:43.509231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf46b-6dac-4300-ae15-279d6a8fde71 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-28fed3bd-d0f9-45f8-95c9-fb1201ff032b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:43.511619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:43.512609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:43.513480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 491/981] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:43.514303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0b41-1c90-46a3-a031-bef88fea8a1b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.514980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0b41-1c90-46a3-a031-bef88fea8a1b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.514980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d0b41-1c90-46a3-a031-bef88fea8a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.527736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:43.534016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-a93d0b41-1c90-46a3-a031-bef88fea8a1b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:43.535238 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a93d0b41-1c90-46a3-a031-bef88fea8a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:43.604925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 492/982] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:43 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:43.605769 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d0b41-1c90-46a3-a031-bef88fea8a1b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.614156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:43.627488 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabf46b-6dac-4300-ae15-279d6a8fde71 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.667075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1d91a-73cb-4699-be1f-6eab1364d94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.667705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d91a-73cb-4699-be1f-6eab1364d94e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.667984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d91a-73cb-4699-be1f-6eab1364d94e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.668519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca1d91a-73cb-4699-be1f-6eab1364d94e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.680148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1d91a-73cb-4699-be1f-6eab1364d94e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.682446 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca1d91a-73cb-4699-be1f-6eab1364d94e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8ca1d91a-73cb-4699-be1f-6eab1364d94e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:43.697483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:43.698640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:43.699702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:43.699702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:43.699702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:43.699702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 491/983] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:43.704243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1d91a-73cb-4699-be1f-6eab1364d94e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.722836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d0b41-1c90-46a3-a031-bef88fea8a1b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.765776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc0d0f-9d4b-46e9-905f-a9e33c009774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.766415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc0d0f-9d4b-46e9-905f-a9e33c009774 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.766691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc0d0f-9d4b-46e9-905f-a9e33c009774 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.766986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dc0d0f-9d4b-46e9-905f-a9e33c009774 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.767615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc0d0f-9d4b-46e9-905f-a9e33c009774 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:43.767931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc0d0f-9d4b-46e9-905f-a9e33c009774 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.769304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11dc0d0f-9d4b-46e9-905f-a9e33c009774 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.773129 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:43.777003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 493/984] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:43.782681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc0d0f-9d4b-46e9-905f-a9e33c009774 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.825102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca1d91a-73cb-4699-be1f-6eab1364d94e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.860793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8917483-ff95-43a4-a5f5-522a51347958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.861401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8917483-ff95-43a4-a5f5-522a51347958 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.861674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8917483-ff95-43a4-a5f5-522a51347958 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.861942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8917483-ff95-43a4-a5f5-522a51347958 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.862590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8917483-ff95-43a4-a5f5-522a51347958 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:43.862927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8917483-ff95-43a4-a5f5-522a51347958 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.864351 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8917483-ff95-43a4-a5f5-522a51347958 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.881067 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 492/985] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:43.881958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8917483-ff95-43a4-a5f5-522a51347958 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.886367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dc0d0f-9d4b-46e9-905f-a9e33c009774 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.896549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:43.920645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1bd1b-2581-41eb-bb0f-99177023a03a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:43.921253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1bd1b-2581-41eb-bb0f-99177023a03a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:43.921529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1bd1b-2581-41eb-bb0f-99177023a03a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:43.921801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a1bd1b-2581-41eb-bb0f-99177023a03a None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:43.922428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1bd1b-2581-41eb-bb0f-99177023a03a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:43.922727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1bd1b-2581-41eb-bb0f-99177023a03a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:43.924139 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a1bd1b-2581-41eb-bb0f-99177023a03a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:43.928973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 494/986] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:43 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:43.929749 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1bd1b-2581-41eb-bb0f-99177023a03a None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:43.982893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8917483-ff95-43a4-a5f5-522a51347958 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:43.989729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:44.016449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027873c-992b-4e22-9b88-db53ba02e568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.017077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027873c-992b-4e22-9b88-db53ba02e568 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.017353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027873c-992b-4e22-9b88-db53ba02e568 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.017620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8027873c-992b-4e22-9b88-db53ba02e568 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.024463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027873c-992b-4e22-9b88-db53ba02e568 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.025913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8027873c-992b-4e22-9b88-db53ba02e568 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.028595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a1bd1b-2581-41eb-bb0f-99177023a03a None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-8027873c-992b-4e22-9b88-db53ba02e568 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:44.036930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:44.037910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:44.038807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:44.038807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:44.038807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:44.038807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:44.038807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:44.038807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:44.038807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:44.038807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:44.038807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 493/987] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:44.038807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027873c-992b-4e22-9b88-db53ba02e568 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.066956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebba420-50a0-423e-bef4-3833a14f86b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.067586 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba420-50a0-423e-bef4-3833a14f86b4 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.067862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba420-50a0-423e-bef4-3833a14f86b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.068135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebba420-50a0-423e-bef4-3833a14f86b4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.068696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebba420-50a0-423e-bef4-3833a14f86b4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.070071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebba420-50a0-423e-bef4-3833a14f86b4 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-2ebba420-50a0-423e-bef4-3833a14f86b4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:44.078729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:44.079862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:44.080697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 495/988] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:43 2022] GET /identity/v3/services/object-store => generated 93 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:44.081498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebba420-50a0-423e-bef4-3833a14f86b4 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.110514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:44.141386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8027873c-992b-4e22-9b88-db53ba02e568 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.174577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285c455-0444-4326-bd53-33b1ed05ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.175210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285c455-0444-4326-bd53-33b1ed05ad53 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.175481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285c455-0444-4326-bd53-33b1ed05ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.175753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c285c455-0444-4326-bd53-33b1ed05ad53 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.176442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285c455-0444-4326-bd53-33b1ed05ad53 None admin] RBAC: Adding query filter params (interface=public, service_id=39ad64b58f9e42489f85cba6bed032cc, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:44.176744 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285c455-0444-4326-bd53-33b1ed05ad53 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.178122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c285c455-0444-4326-bd53-33b1ed05ad53 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.180019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebba420-50a0-423e-bef4-3833a14f86b4 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.185812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 494/989] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/endpoints?service_id=39ad64b58f9e42489f85cba6bed032cc&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:44.186599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285c455-0444-4326-bd53-33b1ed05ad53 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.211530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:44.220086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa19f-5853-46e3-a66b-3893d804e905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.220693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa19f-5853-46e3-a66b-3893d804e905 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.220985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa19f-5853-46e3-a66b-3893d804e905 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.221227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541aa19f-5853-46e3-a66b-3893d804e905 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.221911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa19f-5853-46e3-a66b-3893d804e905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:44.222213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa19f-5853-46e3-a66b-3893d804e905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.223675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541aa19f-5853-46e3-a66b-3893d804e905 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.235401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 496/990] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:44.236207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa19f-5853-46e3-a66b-3893d804e905 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.293212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c285c455-0444-4326-bd53-33b1ed05ad53 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.326014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1631f9-a287-4404-8ade-8a290a158cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.326625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1631f9-a287-4404-8ade-8a290a158cf3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.326931 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1631f9-a287-4404-8ade-8a290a158cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.327200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1631f9-a287-4404-8ade-8a290a158cf3 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.327833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1631f9-a287-4404-8ade-8a290a158cf3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:44.328134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1631f9-a287-4404-8ade-8a290a158cf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.329507 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1631f9-a287-4404-8ade-8a290a158cf3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.331260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:44.334862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 495/991] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:44.335781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541aa19f-5853-46e3-a66b-3893d804e905 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.335924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1631f9-a287-4404-8ade-8a290a158cf3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.371911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fb0c2-a399-4cfe-8587-157e51621607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.372700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fb0c2-a399-4cfe-8587-157e51621607 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.372856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fb0c2-a399-4cfe-8587-157e51621607 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.373036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6fb0c2-a399-4cfe-8587-157e51621607 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.373639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fb0c2-a399-4cfe-8587-157e51621607 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.375049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6fb0c2-a399-4cfe-8587-157e51621607 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.381683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 497/992] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:44.382488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fb0c2-a399-4cfe-8587-157e51621607 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.441385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:44.464892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1631f9-a287-4404-8ade-8a290a158cf3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.497603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6fb0c2-a399-4cfe-8587-157e51621607 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.505789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd6475-4bf2-4b04-9507-44c6080ae4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.507043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6475-4bf2-4b04-9507-44c6080ae4cc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.507548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6475-4bf2-4b04-9507-44c6080ae4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.507964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dd6475-4bf2-4b04-9507-44c6080ae4cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.509088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6475-4bf2-4b04-9507-44c6080ae4cc None admin] RBAC: Adding query filter params (role.id=f523dfe9fc8a4caba222da4603a476ef, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=773fb77106de4530a089e7abca48e333) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:44.509563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6475-4bf2-4b04-9507-44c6080ae4cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.511273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40dd6475-4bf2-4b04-9507-44c6080ae4cc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.521294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 496/993] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/role_assignments?user.id=773fb77106de4530a089e7abca48e333&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=f523dfe9fc8a4caba222da4603a476ef => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:44.540735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25075c75-81cf-4be0-822c-132101a29d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.541448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075c75-81cf-4be0-822c-132101a29d23 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.541803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075c75-81cf-4be0-822c-132101a29d23 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.542135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25075c75-81cf-4be0-822c-132101a29d23 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.542878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25075c75-81cf-4be0-822c-132101a29d23 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:44.543187 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25075c75-81cf-4be0-822c-132101a29d23 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.544668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25075c75-81cf-4be0-822c-132101a29d23 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.550734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 498/994] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:44.557418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd6475-4bf2-4b04-9507-44c6080ae4cc None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.629448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:44.674640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40dd6475-4bf2-4b04-9507-44c6080ae4cc None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.715623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6361c8-db9a-4720-8d3b-22a01061e7cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.716482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6361c8-db9a-4720-8d3b-22a01061e7cd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.716957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6361c8-db9a-4720-8d3b-22a01061e7cd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.717417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6361c8-db9a-4720-8d3b-22a01061e7cd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.718246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6361c8-db9a-4720-8d3b-22a01061e7cd None admin] RBAC: Adding query filter params (interface=admin, service_id=9df0a588413d4736a555e566959950c1, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:44.718565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6361c8-db9a-4720-8d3b-22a01061e7cd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.719999 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6361c8-db9a-4720-8d3b-22a01061e7cd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.726506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 497/995] 10.222.0.59 () {56 vars in 1249 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/endpoints?service_id=9df0a588413d4736a555e566959950c1&interface=admin®ion_id=RegionOne => generated 193 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:44.732845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25075c75-81cf-4be0-822c-132101a29d23 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:44.836897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25075c75-81cf-4be0-822c-132101a29d23 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:44.855799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:44.875200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5dc1f8-c170-4f53-a132-ce6a6a9051f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:44.875819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc1f8-c170-4f53-a132-ce6a6a9051f9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:44.876091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc1f8-c170-4f53-a132-ce6a6a9051f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:44.876344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5dc1f8-c170-4f53-a132-ce6a6a9051f9 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:44.876961 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dc1f8-c170-4f53-a132-ce6a6a9051f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:44.879585 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5dc1f8-c170-4f53-a132-ce6a6a9051f9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:44.888693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 499/996] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Aug 18 20:53:44 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:46.315252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae96a75-4c1a-4fc6-8bea-d38317fa5145 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.315810 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae96a75-4c1a-4fc6-8bea-d38317fa5145 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.315810 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae96a75-4c1a-4fc6-8bea-d38317fa5145 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.317194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 498/997] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:46.322547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5ab89-a485-4032-8871-b94220cddd63 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.323090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5ab89-a485-4032-8871-b94220cddd63 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.323331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5ab89-a485-4032-8871-b94220cddd63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.341876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-26b5ab89-a485-4032-8871-b94220cddd63 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:46.343082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-26b5ab89-a485-4032-8871-b94220cddd63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.415654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 500/998] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:46.485374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64276153-ed3a-4a38-860c-ab16a7a76ede None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.485684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64276153-ed3a-4a38-860c-ab16a7a76ede None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.486077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64276153-ed3a-4a38-860c-ab16a7a76ede None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.487625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 499/999] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:46.492851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922a09-8b14-4044-b7ef-0fbac7ee8945 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.493145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922a09-8b14-4044-b7ef-0fbac7ee8945 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.493393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e922a09-8b14-4044-b7ef-0fbac7ee8945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.513532 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7e922a09-8b14-4044-b7ef-0fbac7ee8945 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:46.514757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7e922a09-8b14-4044-b7ef-0fbac7ee8945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:46.589796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 501/1000] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:46 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:46.677994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64276153-ed3a-4a38-860c-ab16a7a76ede None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.797112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64276153-ed3a-4a38-860c-ab16a7a76ede None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.824148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.832686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0abf-3ecf-464f-9fb3-4382c20f2010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.833307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0abf-3ecf-464f-9fb3-4382c20f2010 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.833578 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0abf-3ecf-464f-9fb3-4382c20f2010 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.833847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b0abf-3ecf-464f-9fb3-4382c20f2010 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.834432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b0abf-3ecf-464f-9fb3-4382c20f2010 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.835836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99b0abf-3ecf-464f-9fb3-4382c20f2010 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a99b0abf-3ecf-464f-9fb3-4382c20f2010 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:46.845206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:46.846218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 18 20:53:46.847115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:46.851411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 500/1001] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:46.852333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e922a09-8b14-4044-b7ef-0fbac7ee8945 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.863259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0abf-3ecf-464f-9fb3-4382c20f2010 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:46.897076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:46.955157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e922a09-8b14-4044-b7ef-0fbac7ee8945 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.965356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b0abf-3ecf-464f-9fb3-4382c20f2010 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:46.989908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ca824-d9e7-4ecf-bb99-bb3425a114fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:46.990501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca824-d9e7-4ecf-bb99-bb3425a114fe None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:46.990792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca824-d9e7-4ecf-bb99-bb3425a114fe None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:46.991087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ca824-d9e7-4ecf-bb99-bb3425a114fe None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:46.991720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ca824-d9e7-4ecf-bb99-bb3425a114fe None admin] RBAC: Adding query filter params (name=compute) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:46.992014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ca824-d9e7-4ecf-bb99-bb3425a114fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:46.993391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ca824-d9e7-4ecf-bb99-bb3425a114fe None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.003354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 502/1002] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:47.003506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a44395-a30d-4f52-9ef6-d226863bfd6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.003639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7d236-fa37-4c5a-9712-40b9bc28f31b None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.003736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44395-a30d-4f52-9ef6-d226863bfd6c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.003821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7d236-fa37-4c5a-9712-40b9bc28f31b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.003915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44395-a30d-4f52-9ef6-d226863bfd6c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.003999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec7d236-fa37-4c5a-9712-40b9bc28f31b None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.004094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a44395-a30d-4f52-9ef6-d226863bfd6c None admin] PATH_INFO: `/v3/services/image` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.004094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a44395-a30d-4f52-9ef6-d226863bfd6c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.004094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a44395-a30d-4f52-9ef6-d226863bfd6c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.004314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 503/1003] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:47.005890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7d236-fa37-4c5a-9712-40b9bc28f31b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a2a44395-a30d-4f52-9ef6-d226863bfd6c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:47.011908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:47.012902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:47.013751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 501/1004] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Aug 18 20:53:46 2022] GET /identity/v3/services/image => generated 86 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:47.014555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15549d-f3ec-4652-9bea-b351d660de34 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.014555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15549d-f3ec-4652-9bea-b351d660de34 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.014698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15549d-f3ec-4652-9bea-b351d660de34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.033649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ae15549d-f3ec-4652-9bea-b351d660de34 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:47.034825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ae15549d-f3ec-4652-9bea-b351d660de34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:47.085374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.101841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 502/1005] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:47 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:47.102398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15549d-f3ec-4652-9bea-b351d660de34 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.122027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec7d236-fa37-4c5a-9712-40b9bc28f31b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.125902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.164732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2287e-2a77-4977-91bb-a07c6bf39797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.165500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2287e-2a77-4977-91bb-a07c6bf39797 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.165779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2287e-2a77-4977-91bb-a07c6bf39797 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.166254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2287e-2a77-4977-91bb-a07c6bf39797 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.167363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2287e-2a77-4977-91bb-a07c6bf39797 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.167673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2287e-2a77-4977-91bb-a07c6bf39797 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.169313 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2287e-2a77-4977-91bb-a07c6bf39797 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.180312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 504/1006] 10.222.0.59 () {56 vars in 1112 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:47.181502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2287e-2a77-4977-91bb-a07c6bf39797 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.217504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15549d-f3ec-4652-9bea-b351d660de34 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.254301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e5486-b765-4d4d-9f04-d4d23a56a6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.254953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5486-b765-4d4d-9f04-d4d23a56a6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.255234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5486-b765-4d4d-9f04-d4d23a56a6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.255508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e5486-b765-4d4d-9f04-d4d23a56a6b5 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.256143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e5486-b765-4d4d-9f04-d4d23a56a6b5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.256444 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e5486-b765-4d4d-9f04-d4d23a56a6b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.257836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e5486-b765-4d4d-9f04-d4d23a56a6b5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.263657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 503/1007] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:47.269154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e5486-b765-4d4d-9f04-d4d23a56a6b5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.288768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2287e-2a77-4977-91bb-a07c6bf39797 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.323121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.324348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117427-368a-4b03-bb38-e7c292183073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.324968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117427-368a-4b03-bb38-e7c292183073 None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.325236 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117427-368a-4b03-bb38-e7c292183073 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.325514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54117427-368a-4b03-bb38-e7c292183073 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.326164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54117427-368a-4b03-bb38-e7c292183073 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.327563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54117427-368a-4b03-bb38-e7c292183073 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.351058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 505/1008] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:47 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:53:47.364873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117427-368a-4b03-bb38-e7c292183073 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.384847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e5486-b765-4d4d-9f04-d4d23a56a6b5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.395116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.435474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e57d4-8ccd-4f35-9595-a15a6c08d080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.436086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e57d4-8ccd-4f35-9595-a15a6c08d080 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.436453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e57d4-8ccd-4f35-9595-a15a6c08d080 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.436625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0e57d4-8ccd-4f35-9595-a15a6c08d080 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.437243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e57d4-8ccd-4f35-9595-a15a6c08d080 None admin] RBAC: Adding query filter params (type=image) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.437837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e57d4-8ccd-4f35-9595-a15a6c08d080 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.438949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0e57d4-8ccd-4f35-9595-a15a6c08d080 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.454806 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 504/1009] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/services?type=image => generated 122 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:47.503953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54117427-368a-4b03-bb38-e7c292183073 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.545720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79f621-474a-4334-a8c2-258ec5178b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.546380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79f621-474a-4334-a8c2-258ec5178b5f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.546656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79f621-474a-4334-a8c2-258ec5178b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.546996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e79f621-474a-4334-a8c2-258ec5178b5f None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.547591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79f621-474a-4334-a8c2-258ec5178b5f None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.548992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e79f621-474a-4334-a8c2-258ec5178b5f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-9e79f621-474a-4334-a8c2-258ec5178b5f None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:47.559122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:47.560165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:47.561017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 506/1010] 10.222.0.59 () {56 vars in 1126 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:47.566633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e57d4-8ccd-4f35-9595-a15a6c08d080 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.673997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0e57d4-8ccd-4f35-9595-a15a6c08d080 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.685110 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.713293 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae27c-4395-4af5-b803-fee78d9e53c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.714128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae27c-4395-4af5-b803-fee78d9e53c5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.714636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae27c-4395-4af5-b803-fee78d9e53c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.715003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ae27c-4395-4af5-b803-fee78d9e53c5 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.715705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ae27c-4395-4af5-b803-fee78d9e53c5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.716076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ae27c-4395-4af5-b803-fee78d9e53c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.717522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ae27c-4395-4af5-b803-fee78d9e53c5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.722821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 505/1011] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:47.728364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79f621-474a-4334-a8c2-258ec5178b5f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:47.831295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:47.844110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e79f621-474a-4334-a8c2-258ec5178b5f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:47.880021 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abad5a6-bafe-47df-99b8-0e0d755af3d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:47.880631 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad5a6-bafe-47df-99b8-0e0d755af3d1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:47.880902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad5a6-bafe-47df-99b8-0e0d755af3d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:47.881165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abad5a6-bafe-47df-99b8-0e0d755af3d1 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:47.881769 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abad5a6-bafe-47df-99b8-0e0d755af3d1 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:47.882084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abad5a6-bafe-47df-99b8-0e0d755af3d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:47.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abad5a6-bafe-47df-99b8-0e0d755af3d1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:47.890813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 507/1012] 10.222.0.59 () {56 vars in 1122 bytes} [Thu Aug 18 20:53:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:47.896671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae27c-4395-4af5-b803-fee78d9e53c5 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:48.006653 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ae27c-4395-4af5-b803-fee78d9e53c5 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:48.044670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9d77fb-5fba-43ad-9015-5e3637bac9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:48.045278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d77fb-5fba-43ad-9015-5e3637bac9d4 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:48.045557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d77fb-5fba-43ad-9015-5e3637bac9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:48.045827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9d77fb-5fba-43ad-9015-5e3637bac9d4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:48.046492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d77fb-5fba-43ad-9015-5e3637bac9d4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:48.047904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9d77fb-5fba-43ad-9015-5e3637bac9d4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:48.074800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 506/1013] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:47 2022] POST /identity/v3/endpoints => generated 325 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:49.343832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae229a42-28c4-4065-af41-ea446f5179a7 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.344397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae229a42-28c4-4065-af41-ea446f5179a7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.344397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae229a42-28c4-4065-af41-ea446f5179a7 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.345867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 508/1014] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:49.351182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cabe78-d304-4bcf-b0e3-03bde2c8e4b1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.351593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cabe78-d304-4bcf-b0e3-03bde2c8e4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.351687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cabe78-d304-4bcf-b0e3-03bde2c8e4b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.370349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-95cabe78-d304-4bcf-b0e3-03bde2c8e4b1 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:49.371556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-95cabe78-d304-4bcf-b0e3-03bde2c8e4b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.384182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720504b-8cae-47a5-8328-96661f1dac6d None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.384438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720504b-8cae-47a5-8328-96661f1dac6d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.384746 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0720504b-8cae-47a5-8328-96661f1dac6d None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.386475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 509/1015] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:49.391447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14b5b-14f0-4ad7-838e-2db8363d373e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.391715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14b5b-14f0-4ad7-838e-2db8363d373e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.391997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec14b5b-14f0-4ad7-838e-2db8363d373e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.401340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.411020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-2ec14b5b-14f0-4ad7-838e-2db8363d373e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:49.412209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2ec14b5b-14f0-4ad7-838e-2db8363d373e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:49.456739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 507/1016] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:49.482792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 510/1017] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:49.723436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cabe78-d304-4bcf-b0e3-03bde2c8e4b1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.751983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec14b5b-14f0-4ad7-838e-2db8363d373e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.830666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cabe78-d304-4bcf-b0e3-03bde2c8e4b1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.848225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.866846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2d8fc-3536-4a6f-aeb4-c2b0f76aeab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.867461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2d8fc-3536-4a6f-aeb4-c2b0f76aeab4 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.867737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2d8fc-3536-4a6f-aeb4-c2b0f76aeab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.868003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de2d8fc-3536-4a6f-aeb4-c2b0f76aeab4 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.868659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2d8fc-3536-4a6f-aeb4-c2b0f76aeab4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:49.869180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec14b5b-14f0-4ad7-838e-2db8363d373e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:49.870146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de2d8fc-3536-4a6f-aeb4-c2b0f76aeab4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:49.890844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 508/1018] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/services => generated 242 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:49.915750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188c420-b9d8-462d-b90b-a4166a8d1e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:49.916508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c420-b9d8-462d-b90b-a4166a8d1e17 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.916990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c420-b9d8-462d-b90b-a4166a8d1e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.918682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c420-b9d8-462d-b90b-a4166a8d1e17 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.931388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188c420-b9d8-462d-b90b-a4166a8d1e17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-f188c420-b9d8-462d-b90b-a4166a8d1e17 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:49.936343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:49.937575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:49.938627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:49.946200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 511/1019] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:49.947462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2d8fc-3536-4a6f-aeb4-c2b0f76aeab4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:49.974499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:49.975964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3d41-1f2c-416f-a196-cf2129e6a26d None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.976234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3d41-1f2c-416f-a196-cf2129e6a26d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.976473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267c3d41-1f2c-416f-a196-cf2129e6a26d None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:49.977911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 512/1020] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:49.983853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aac23a-80f7-4aed-89f4-c6de25dcf9c5 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:49.984135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aac23a-80f7-4aed-89f4-c6de25dcf9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:49.984405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63aac23a-80f7-4aed-89f4-c6de25dcf9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.010997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-63aac23a-80f7-4aed-89f4-c6de25dcf9c5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:50.012523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-63aac23a-80f7-4aed-89f4-c6de25dcf9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:50.102145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 513/1021] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:49 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:50.102669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de2d8fc-3536-4a6f-aeb4-c2b0f76aeab4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.140169 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640fe69-e5ec-411a-ba66-871577b23fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.141084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640fe69-e5ec-411a-ba66-871577b23fd6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.141476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640fe69-e5ec-411a-ba66-871577b23fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.141946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2640fe69-e5ec-411a-ba66-871577b23fd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.142984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640fe69-e5ec-411a-ba66-871577b23fd6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:50.143427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640fe69-e5ec-411a-ba66-871577b23fd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.145710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2640fe69-e5ec-411a-ba66-871577b23fd6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.156593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 509/1022] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Aug 18 20:53:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:50.162587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aac23a-80f7-4aed-89f4-c6de25dcf9c5 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.229202 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.264008 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63aac23a-80f7-4aed-89f4-c6de25dcf9c5 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.299834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba1ece-d8fe-4e64-87a4-59ed1b0f715a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.300462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1ece-d8fe-4e64-87a4-59ed1b0f715a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.300735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1ece-d8fe-4e64-87a4-59ed1b0f715a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.300999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ba1ece-d8fe-4e64-87a4-59ed1b0f715a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.311279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba1ece-d8fe-4e64-87a4-59ed1b0f715a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.312754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ba1ece-d8fe-4e64-87a4-59ed1b0f715a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-c9ba1ece-d8fe-4e64-87a4-59ed1b0f715a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:50.327247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:50.328201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:50.329115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:50.329115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:50.329115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:50.329869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 514/1023] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:50.334343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640fe69-e5ec-411a-ba66-871577b23fd6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.369127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba1ece-d8fe-4e64-87a4-59ed1b0f715a None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.427730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.450614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2640fe69-e5ec-411a-ba66-871577b23fd6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.492320 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eb45f-c516-4d5b-a326-bbf0984c1807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.492841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eb45f-c516-4d5b-a326-bbf0984c1807 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.493116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eb45f-c516-4d5b-a326-bbf0984c1807 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.493382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697eb45f-c516-4d5b-a326-bbf0984c1807 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.493877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ba1ece-d8fe-4e64-87a4-59ed1b0f715a None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.494042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697eb45f-c516-4d5b-a326-bbf0984c1807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:50.494313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697eb45f-c516-4d5b-a326-bbf0984c1807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.496023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697eb45f-c516-4d5b-a326-bbf0984c1807 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.509678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 510/1024] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:50.515485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eb45f-c516-4d5b-a326-bbf0984c1807 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.516774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.536962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0d256-9fb2-4117-a975-a283afc35075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.537655 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0d256-9fb2-4117-a975-a283afc35075 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.537937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0d256-9fb2-4117-a975-a283afc35075 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.538212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a0d256-9fb2-4117-a975-a283afc35075 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.539785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0d256-9fb2-4117-a975-a283afc35075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.541823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a0d256-9fb2-4117-a975-a283afc35075 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.546934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 515/1025] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:50.550399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0d256-9fb2-4117-a975-a283afc35075 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.631641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697eb45f-c516-4d5b-a326-bbf0984c1807 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.659841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a0d256-9fb2-4117-a975-a283afc35075 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.670370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef03e2e-6cf9-489f-b52e-7a33fc038ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.671440 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef03e2e-6cf9-489f-b52e-7a33fc038ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.671902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef03e2e-6cf9-489f-b52e-7a33fc038ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.672178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef03e2e-6cf9-489f-b52e-7a33fc038ab9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.679731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef03e2e-6cf9-489f-b52e-7a33fc038ab9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.681292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef03e2e-6cf9-489f-b52e-7a33fc038ab9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5ef03e2e-6cf9-489f-b52e-7a33fc038ab9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:50.692897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:50.694070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:50.695383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:50.695383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:50.695383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:50.695383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:50.695383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:50.695383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:50.695383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:50.695383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:50.695383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:50.695383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:50.701663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 511/1026] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:50.701798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cd819-bdab-4e33-bcd3-f571c6a67f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.701798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cd819-bdab-4e33-bcd3-f571c6a67f72 None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.701798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cd819-bdab-4e33-bcd3-f571c6a67f72 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.701798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176cd819-bdab-4e33-bcd3-f571c6a67f72 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.702153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cd819-bdab-4e33-bcd3-f571c6a67f72 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.702153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176cd819-bdab-4e33-bcd3-f571c6a67f72 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.703581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef03e2e-6cf9-489f-b52e-7a33fc038ab9 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.706540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:50.732061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 516/1027] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:53:50 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:53:50.828176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef03e2e-6cf9-489f-b52e-7a33fc038ab9 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:50.864784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7ac21-7194-42cf-8869-65a70e7989f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:50.865410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7ac21-7194-42cf-8869-65a70e7989f6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:50.865692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7ac21-7194-42cf-8869-65a70e7989f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:50.865980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7ac21-7194-42cf-8869-65a70e7989f6 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:50.866789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7ac21-7194-42cf-8869-65a70e7989f6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:50.867122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7ac21-7194-42cf-8869-65a70e7989f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:50.868667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7ac21-7194-42cf-8869-65a70e7989f6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:50.889466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 512/1028] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:50.895909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cd819-bdab-4e33-bcd3-f571c6a67f72 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:50.945078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:51.010137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176cd819-bdab-4e33-bcd3-f571c6a67f72 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.048079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc92031-7d30-4128-a0fd-fddf08adab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.048610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92031-7d30-4128-a0fd-fddf08adab42 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.048885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92031-7d30-4128-a0fd-fddf08adab42 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.049164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc92031-7d30-4128-a0fd-fddf08adab42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.117201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc92031-7d30-4128-a0fd-fddf08adab42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.118688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc92031-7d30-4128-a0fd-fddf08adab42 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.159592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:51.220405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 517/1029] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:50 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:53:51.226250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7ac21-7194-42cf-8869-65a70e7989f6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.289199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:51.331777 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7ac21-7194-42cf-8869-65a70e7989f6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.367469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfa379-c3f5-410d-8d6a-8ddf98c655ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.368114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa379-c3f5-410d-8d6a-8ddf98c655ad None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.368391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa379-c3f5-410d-8d6a-8ddf98c655ad None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.368661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cfa379-c3f5-410d-8d6a-8ddf98c655ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.379387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfa379-c3f5-410d-8d6a-8ddf98c655ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.380842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cfa379-c3f5-410d-8d6a-8ddf98c655ad None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-40cfa379-c3f5-410d-8d6a-8ddf98c655ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:51.396094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:51.397111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:51.398013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:51.398013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:51.398013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:51.399233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 513/1030] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:51.403386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc92031-7d30-4128-a0fd-fddf08adab42 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.505423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc92031-7d30-4128-a0fd-fddf08adab42 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.540482 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dd9b9-e3ef-4cde-9e19-eb71e276b46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.541096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dd9b9-e3ef-4cde-9e19-eb71e276b46b None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.541376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dd9b9-e3ef-4cde-9e19-eb71e276b46b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.541764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89dd9b9-e3ef-4cde-9e19-eb71e276b46b None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.542487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dd9b9-e3ef-4cde-9e19-eb71e276b46b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:51.542757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dd9b9-e3ef-4cde-9e19-eb71e276b46b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.544275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89dd9b9-e3ef-4cde-9e19-eb71e276b46b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.552829 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:51.562648 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 518/1031] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:51.563952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfa379-c3f5-410d-8d6a-8ddf98c655ad None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.666546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cfa379-c3f5-410d-8d6a-8ddf98c655ad None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.679647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:51.702402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bf7e09-ce32-48e1-bdcc-45bee8e9eb5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.703069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf7e09-ce32-48e1-bdcc-45bee8e9eb5f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.703346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf7e09-ce32-48e1-bdcc-45bee8e9eb5f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.703622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bf7e09-ce32-48e1-bdcc-45bee8e9eb5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.710468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf7e09-ce32-48e1-bdcc-45bee8e9eb5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.711952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bf7e09-ce32-48e1-bdcc-45bee8e9eb5f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-65bf7e09-ce32-48e1-bdcc-45bee8e9eb5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:51.724364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:51.725258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:51.726138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:51.726138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:51.726138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:51.726138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:51.726138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:51.726138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:51.726138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:51.726138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:51.730553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 514/1032] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:51.731845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dd9b9-e3ef-4cde-9e19-eb71e276b46b None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.833908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09f25-085d-4637-8cc7-6a3beac94493 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.834193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09f25-085d-4637-8cc7-6a3beac94493 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.834475 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d09f25-085d-4637-8cc7-6a3beac94493 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.836007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 515/1033] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:51.841013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306fc0f-a87e-4f75-9266-e88dea52a4b9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.841298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306fc0f-a87e-4f75-9266-e88dea52a4b9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.841572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d306fc0f-a87e-4f75-9266-e88dea52a4b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.848444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89dd9b9-e3ef-4cde-9e19-eb71e276b46b None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:51.860686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d306fc0f-a87e-4f75-9266-e88dea52a4b9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:51.861902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d306fc0f-a87e-4f75-9266-e88dea52a4b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:51.887379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2719-3eb3-4d11-9a60-d5835a76a0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:51.888544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2719-3eb3-4d11-9a60-d5835a76a0a9 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:51.888965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2719-3eb3-4d11-9a60-d5835a76a0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:51.889248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40af2719-3eb3-4d11-9a60-d5835a76a0a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:51.890131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af2719-3eb3-4d11-9a60-d5835a76a0a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:51.890446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af2719-3eb3-4d11-9a60-d5835a76a0a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:51.892741 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40af2719-3eb3-4d11-9a60-d5835a76a0a9 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:51.913075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 519/1034] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:51.914764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2719-3eb3-4d11-9a60-d5835a76a0a9 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:51.933915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 516/1035] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:51 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:51.982144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:52.023963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40af2719-3eb3-4d11-9a60-d5835a76a0a9 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.058968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adde8c-b738-4fdb-a0b4-83c5af6801de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.059573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adde8c-b738-4fdb-a0b4-83c5af6801de None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.059848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adde8c-b738-4fdb-a0b4-83c5af6801de None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.060116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04adde8c-b738-4fdb-a0b4-83c5af6801de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.060838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adde8c-b738-4fdb-a0b4-83c5af6801de None admin] RBAC: Adding query filter params (role.id=f523dfe9fc8a4caba222da4603a476ef, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=c6ceb08f9eda4942a510bfaa0f0ef84e) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:52.061142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adde8c-b738-4fdb-a0b4-83c5af6801de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.062581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04adde8c-b738-4fdb-a0b4-83c5af6801de None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.068290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 520/1036] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:51 2022] GET /identity/v3/role_assignments?user.id=c6ceb08f9eda4942a510bfaa0f0ef84e&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=f523dfe9fc8a4caba222da4603a476ef => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:52.209148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306fc0f-a87e-4f75-9266-e88dea52a4b9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:52.312851 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d306fc0f-a87e-4f75-9266-e88dea52a4b9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.314372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:52.348669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f690106-ed8f-4e9e-82a5-8fae72bcfa75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.349318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f690106-ed8f-4e9e-82a5-8fae72bcfa75 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.349588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f690106-ed8f-4e9e-82a5-8fae72bcfa75 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.349846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f690106-ed8f-4e9e-82a5-8fae72bcfa75 None admin] PATH_INFO: `/v3/services/image` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.350415 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f690106-ed8f-4e9e-82a5-8fae72bcfa75 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.351823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f690106-ed8f-4e9e-82a5-8fae72bcfa75 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6f690106-ed8f-4e9e-82a5-8fae72bcfa75 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:52.360717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:52.361729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:52.363830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 517/1037] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Aug 18 20:53:52 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:52.368258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adde8c-b738-4fdb-a0b4-83c5af6801de None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:52.476595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04adde8c-b738-4fdb-a0b4-83c5af6801de None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.500943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:52.513825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2fcc6-c25c-4df4-b29a-fc975ce9ac47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.514467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2fcc6-c25c-4df4-b29a-fc975ce9ac47 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.514741 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2fcc6-c25c-4df4-b29a-fc975ce9ac47 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.515050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b2fcc6-c25c-4df4-b29a-fc975ce9ac47 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.515689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2fcc6-c25c-4df4-b29a-fc975ce9ac47 None admin] RBAC: Adding query filter params (name=image) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:52.515987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2fcc6-c25c-4df4-b29a-fc975ce9ac47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.517353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b2fcc6-c25c-4df4-b29a-fc975ce9ac47 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.523197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 521/1038] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:52.529302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f690106-ed8f-4e9e-82a5-8fae72bcfa75 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:52.635963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f690106-ed8f-4e9e-82a5-8fae72bcfa75 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.671470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097cb02c-f1a0-4561-8c10-fb51ee58de02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.672079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cb02c-f1a0-4561-8c10-fb51ee58de02 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.672358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cb02c-f1a0-4561-8c10-fb51ee58de02 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.672634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097cb02c-f1a0-4561-8c10-fb51ee58de02 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.673256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cb02c-f1a0-4561-8c10-fb51ee58de02 None admin] RBAC: Adding query filter params (type=image) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:52.673556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cb02c-f1a0-4561-8c10-fb51ee58de02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.674967 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097cb02c-f1a0-4561-8c10-fb51ee58de02 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.680411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 518/1039] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:52 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:52.686574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2fcc6-c25c-4df4-b29a-fc975ce9ac47 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:52.708698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8655f9-06ab-4b1e-9d08-e84097feb15d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.709037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8655f9-06ab-4b1e-9d08-e84097feb15d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.709259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8655f9-06ab-4b1e-9d08-e84097feb15d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.710619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 519/1040] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:53:52.716103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7139b2-c0a8-474e-86ec-2151042e39bd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.716384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7139b2-c0a8-474e-86ec-2151042e39bd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.716658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7139b2-c0a8-474e-86ec-2151042e39bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.734741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2d7139b2-c0a8-474e-86ec-2151042e39bd None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:52.735908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2d7139b2-c0a8-474e-86ec-2151042e39bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:52.760973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:52.804953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b2fcc6-c25c-4df4-b29a-fc975ce9ac47 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.809464 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 520/1041] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:52 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:52.840785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cf550-563d-4f5c-b140-fae74d4231e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.841969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf550-563d-4f5c-b140-fae74d4231e3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.842203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf550-563d-4f5c-b140-fae74d4231e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.842442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35cf550-563d-4f5c-b140-fae74d4231e3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:52.843194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cf550-563d-4f5c-b140-fae74d4231e3 None admin] RBAC: Adding query filter params (interface=public, service_id=22d660834fa84124a8472b92b7ee0cbe, region_id=RegionOne) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:52.843507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cf550-563d-4f5c-b140-fae74d4231e3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:52.844890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35cf550-563d-4f5c-b140-fae74d4231e3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:52.855126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 522/1042] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Aug 18 20:53:52 2022] GET /identity/v3/endpoints?service_id=22d660834fa84124a8472b92b7ee0cbe&interface=public®ion_id=RegionOne => generated 194 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:52.856437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7139b2-c0a8-474e-86ec-2151042e39bd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:52.963055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7139b2-c0a8-474e-86ec-2151042e39bd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:52.998420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccf057-9720-4fb0-a550-756791e9ccd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:52.998976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccf057-9720-4fb0-a550-756791e9ccd4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:52.999250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccf057-9720-4fb0-a550-756791e9ccd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:52.999515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ccf057-9720-4fb0-a550-756791e9ccd4 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.000118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccf057-9720-4fb0-a550-756791e9ccd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:53.001481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ccf057-9720-4fb0-a550-756791e9ccd4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:53.008363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 521/1043] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Aug 18 20:53:52 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 20:53:53.079437 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cf550-563d-4f5c-b140-fae74d4231e3 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.140685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:53.197240 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35cf550-563d-4f5c-b140-fae74d4231e3 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:53.235291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a32cfc-bdab-4a96-bbff-8e726a978602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:53.236188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a32cfc-bdab-4a96-bbff-8e726a978602 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.236690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a32cfc-bdab-4a96-bbff-8e726a978602 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.237200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a32cfc-bdab-4a96-bbff-8e726a978602 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.238475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a32cfc-bdab-4a96-bbff-8e726a978602 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:53.240095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a32cfc-bdab-4a96-bbff-8e726a978602 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:53.242193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 523/1044] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:53.247829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccf057-9720-4fb0-a550-756791e9ccd4 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:53.276400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:53.355770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ccf057-9720-4fb0-a550-756791e9ccd4 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:53.391255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e173b380-2df3-47aa-8fe8-d5b8ee342e79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:53.391866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173b380-2df3-47aa-8fe8-d5b8ee342e79 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.392145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173b380-2df3-47aa-8fe8-d5b8ee342e79 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.392411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e173b380-2df3-47aa-8fe8-d5b8ee342e79 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.393058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173b380-2df3-47aa-8fe8-d5b8ee342e79 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:53.394495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e173b380-2df3-47aa-8fe8-d5b8ee342e79 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:53.421734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 522/1045] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:53:53 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:53.986503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722ec93-7025-4c23-ae9b-ff87baec3380 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.987112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722ec93-7025-4c23-ae9b-ff87baec3380 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.987112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c722ec93-7025-4c23-ae9b-ff87baec3380 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:53.988616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 524/1046] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:53.993708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e697d5-24bf-41d8-ac4d-496ab7ec4fbb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:53.994148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e697d5-24bf-41d8-ac4d-496ab7ec4fbb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:53.994228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e697d5-24bf-41d8-ac4d-496ab7ec4fbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.012790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-42e697d5-24bf-41d8-ac4d-496ab7ec4fbb None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:54.014022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-42e697d5-24bf-41d8-ac4d-496ab7ec4fbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:54.090164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 523/1047] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:53 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:54.356669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722ec93-7025-4c23-ae9b-ff87baec3380 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.463240 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c722ec93-7025-4c23-ae9b-ff87baec3380 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.485521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.507391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29807a8b-8478-47ec-955f-6e9a255d843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.508241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29807a8b-8478-47ec-955f-6e9a255d843f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.508502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29807a8b-8478-47ec-955f-6e9a255d843f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.508801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29807a8b-8478-47ec-955f-6e9a255d843f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.521309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29807a8b-8478-47ec-955f-6e9a255d843f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-29807a8b-8478-47ec-955f-6e9a255d843f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:54.526084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:54.527377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:54.528243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:54.530927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 525/1048] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:54.533447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e697d5-24bf-41d8-ac4d-496ab7ec4fbb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.545954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.641971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e697d5-24bf-41d8-ac4d-496ab7ec4fbb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.677484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9339fae-db16-4234-8c0d-aad638b09afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.678097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339fae-db16-4234-8c0d-aad638b09afb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.678370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339fae-db16-4234-8c0d-aad638b09afb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.678640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9339fae-db16-4234-8c0d-aad638b09afb None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.679344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339fae-db16-4234-8c0d-aad638b09afb None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:54.679684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339fae-db16-4234-8c0d-aad638b09afb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.681131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9339fae-db16-4234-8c0d-aad638b09afb None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.689778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 524/1049] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:54.695534 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29807a8b-8478-47ec-955f-6e9a255d843f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.807691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29807a8b-8478-47ec-955f-6e9a255d843f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.844927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310ea75-112b-49a4-921f-709d82bf0b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:54.845997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ea75-112b-49a4-921f-709d82bf0b55 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.846505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ea75-112b-49a4-921f-709d82bf0b55 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.847012 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310ea75-112b-49a4-921f-709d82bf0b55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.859721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310ea75-112b-49a4-921f-709d82bf0b55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:54.861519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310ea75-112b-49a4-921f-709d82bf0b55 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-2310ea75-112b-49a4-921f-709d82bf0b55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:54.877208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:54.878199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:54.879170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:54.879170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:54.879170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:54.884843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 526/1050] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:54.886175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9339fae-db16-4234-8c0d-aad638b09afb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:54.897495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fcb6b-8db2-4d0c-8d18-0c59224e6997 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.897702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fcb6b-8db2-4d0c-8d18-0c59224e6997 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.897971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599fcb6b-8db2-4d0c-8d18-0c59224e6997 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.899382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 527/1051] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:54.904518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8100c-2b65-482a-aa68-0739662d92ad None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:54.904800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8100c-2b65-482a-aa68-0739662d92ad None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:54.905068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc8100c-2b65-482a-aa68-0739662d92ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:54.923729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-adc8100c-2b65-482a-aa68-0739662d92ad None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:54.924937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-adc8100c-2b65-482a-aa68-0739662d92ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:54.952691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.962817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:54.995365 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9339fae-db16-4234-8c0d-aad638b09afb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:54.998592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 528/1052] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:55.035335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d34f-108a-42a0-8aa1-87162b6bc2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.036242 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d34f-108a-42a0-8aa1-87162b6bc2dd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.036691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d34f-108a-42a0-8aa1-87162b6bc2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.037152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d34f-108a-42a0-8aa1-87162b6bc2dd None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.037965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286d34f-108a-42a0-8aa1-87162b6bc2dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:55.038452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286d34f-108a-42a0-8aa1-87162b6bc2dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.040022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286d34f-108a-42a0-8aa1-87162b6bc2dd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.053097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 525/1053] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:55.058862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8100c-2b65-482a-aa68-0739662d92ad None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.163442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc8100c-2b65-482a-aa68-0739662d92ad None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.197849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaeed5-8008-4151-9228-aa1e29b27cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.198603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaeed5-8008-4151-9228-aa1e29b27cef None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.198926 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaeed5-8008-4151-9228-aa1e29b27cef None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.199196 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfaeed5-8008-4151-9228-aa1e29b27cef None admin] PATH_INFO: `/v3/users/nova` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.206256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaeed5-8008-4151-9228-aa1e29b27cef None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.207721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfaeed5-8008-4151-9228-aa1e29b27cef None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-4dfaeed5-8008-4151-9228-aa1e29b27cef None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:55.219674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:55.220607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:55.226401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 529/1054] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:55.228507 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d34f-108a-42a0-8aa1-87162b6bc2dd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.271103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaeed5-8008-4151-9228-aa1e29b27cef None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.297475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.336510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d34f-108a-42a0-8aa1-87162b6bc2dd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.366815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.373053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7c2b4-bbc4-4a3c-b2f1-d7b1195357f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.373615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c2b4-bbc4-4a3c-b2f1-d7b1195357f0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.373891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c2b4-bbc4-4a3c-b2f1-d7b1195357f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.374156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7c2b4-bbc4-4a3c-b2f1-d7b1195357f0 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.374914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7c2b4-bbc4-4a3c-b2f1-d7b1195357f0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:55.375422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7c2b4-bbc4-4a3c-b2f1-d7b1195357f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.376651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7c2b4-bbc4-4a3c-b2f1-d7b1195357f0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.381840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfaeed5-8008-4151-9228-aa1e29b27cef None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.394179 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 526/1055] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:55.395876 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f780-30ad-4e6a-b595-3dd7c2ed5e11 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.396162 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f780-30ad-4e6a-b595-3dd7c2ed5e11 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.396430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b28f780-30ad-4e6a-b595-3dd7c2ed5e11 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.397934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 527/1056] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:55.399929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28f780-30ad-4e6a-b595-3dd7c2ed5e11 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.417137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b02fa4-838f-49b1-bea4-ea3343728050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.417772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02fa4-838f-49b1-bea4-ea3343728050 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.418053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02fa4-838f-49b1-bea4-ea3343728050 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.418326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b02fa4-838f-49b1-bea4-ea3343728050 None admin] PATH_INFO: `/v3/services/image` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.418944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b02fa4-838f-49b1-bea4-ea3343728050 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.420460 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b02fa4-838f-49b1-bea4-ea3343728050 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-42b02fa4-838f-49b1-bea4-ea3343728050 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:55.428906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:55.429902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:55.430791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 530/1057] 10.222.0.59 () {56 vars in 1105 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:55.431638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2fbad-fe2e-4847-a7e4-4f7384d57186 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.431638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2fbad-fe2e-4847-a7e4-4f7384d57186 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.431638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b2fbad-fe2e-4847-a7e4-4f7384d57186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.449173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-47b2fbad-fe2e-4847-a7e4-4f7384d57186 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:55.450356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-47b2fbad-fe2e-4847-a7e4-4f7384d57186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:55.504619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b28f780-30ad-4e6a-b595-3dd7c2ed5e11 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.516798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 531/1058] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:55.517802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2fbad-fe2e-4847-a7e4-4f7384d57186 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.536465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.544775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c08a-3040-4473-9f5d-96fac4357962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.545570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c08a-3040-4473-9f5d-96fac4357962 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.545852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c08a-3040-4473-9f5d-96fac4357962 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.546121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979c08a-3040-4473-9f5d-96fac4357962 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.556457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979c08a-3040-4473-9f5d-96fac4357962 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.558194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979c08a-3040-4473-9f5d-96fac4357962 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4979c08a-3040-4473-9f5d-96fac4357962 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:55.572632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:55.573855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:55.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:55.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:55.575049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:55.578794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 528/1059] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:55.579648 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c08a-3040-4473-9f5d-96fac4357962 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.629365 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.632610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b2fbad-fe2e-4847-a7e4-4f7384d57186 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.669011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7d920-a7a0-4d2b-86dd-d49fbea6233c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.669929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d920-a7a0-4d2b-86dd-d49fbea6233c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.670392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d920-a7a0-4d2b-86dd-d49fbea6233c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.670867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7d920-a7a0-4d2b-86dd-d49fbea6233c None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.671673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7d920-a7a0-4d2b-86dd-d49fbea6233c None admin] RBAC: Adding query filter params (name=image) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:55.672147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7d920-a7a0-4d2b-86dd-d49fbea6233c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.673713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7d920-a7a0-4d2b-86dd-d49fbea6233c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.678761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 532/1060] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:55.685206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7d920-a7a0-4d2b-86dd-d49fbea6233c None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.702051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979c08a-3040-4473-9f5d-96fac4357962 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.751976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b7d73-1ab0-4edb-b440-a9e7591b5c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.752873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b7d73-1ab0-4edb-b440-a9e7591b5c0f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.753318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b7d73-1ab0-4edb-b440-a9e7591b5c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.753714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b7d73-1ab0-4edb-b440-a9e7591b5c0f None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.754796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b7d73-1ab0-4edb-b440-a9e7591b5c0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:55.755309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b7d73-1ab0-4edb-b440-a9e7591b5c0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.757666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b7d73-1ab0-4edb-b440-a9e7591b5c0f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.774829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 529/1061] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:55.780013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b7d73-1ab0-4edb-b440-a9e7591b5c0f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.800413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.819998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7d920-a7a0-4d2b-86dd-d49fbea6233c None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.855085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17ff29-b7a5-4e2a-8af4-fecad2925c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.855701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17ff29-b7a5-4e2a-8af4-fecad2925c74 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.855983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17ff29-b7a5-4e2a-8af4-fecad2925c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.856260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da17ff29-b7a5-4e2a-8af4-fecad2925c74 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.856895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17ff29-b7a5-4e2a-8af4-fecad2925c74 None admin] RBAC: Adding query filter params (type=image) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:55.857199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17ff29-b7a5-4e2a-8af4-fecad2925c74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.858589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da17ff29-b7a5-4e2a-8af4-fecad2925c74 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.868221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 533/1062] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:55.868221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17ff29-b7a5-4e2a-8af4-fecad2925c74 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.884919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b7d73-1ab0-4edb-b440-a9e7591b5c0f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:55.888186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:55.922824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc5bfd-4ba6-4c5f-bb9b-72d693f43070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:55.923379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc5bfd-4ba6-4c5f-bb9b-72d693f43070 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:55.923653 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc5bfd-4ba6-4c5f-bb9b-72d693f43070 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:55.923917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fc5bfd-4ba6-4c5f-bb9b-72d693f43070 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:55.930459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc5bfd-4ba6-4c5f-bb9b-72d693f43070 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:55.931943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fc5bfd-4ba6-4c5f-bb9b-72d693f43070 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d6fc5bfd-4ba6-4c5f-bb9b-72d693f43070 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:53:55.942819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:55.943737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:55.944657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:53:55.944657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:53:55.944657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:53:55.944657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:53:55.944657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:53:55.944657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:53:55.944657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:53:55.944657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:55.944657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 530/1063] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:55.944657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc5bfd-4ba6-4c5f-bb9b-72d693f43070 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:55.976482 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da17ff29-b7a5-4e2a-8af4-fecad2925c74 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.010932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827f820-51ae-44ec-941d-d1227314f9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.011609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827f820-51ae-44ec-941d-d1227314f9ab None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.012303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827f820-51ae-44ec-941d-d1227314f9ab None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.012303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8827f820-51ae-44ec-941d-d1227314f9ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.023415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8827f820-51ae-44ec-941d-d1227314f9ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-8827f820-51ae-44ec-941d-d1227314f9ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:56.028380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:56.029398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:56.030257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 534/1064] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:56.031018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827f820-51ae-44ec-941d-d1227314f9ab None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.037619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.047800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fc5bfd-4ba6-4c5f-bb9b-72d693f43070 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.081280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713a7ef-eaf0-4323-8a27-eef21c087b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.081881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713a7ef-eaf0-4323-8a27-eef21c087b07 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.082152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713a7ef-eaf0-4323-8a27-eef21c087b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.082412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d713a7ef-eaf0-4323-8a27-eef21c087b07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.083088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713a7ef-eaf0-4323-8a27-eef21c087b07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.084442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d713a7ef-eaf0-4323-8a27-eef21c087b07 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.105394 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 531/1065] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 20:53:55 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:53:56.106218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713a7ef-eaf0-4323-8a27-eef21c087b07 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.129294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.147953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8827f820-51ae-44ec-941d-d1227314f9ab None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.194189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84610-dce9-462f-9e37-e258fd5a5a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.195143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84610-dce9-462f-9e37-e258fd5a5a56 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.195418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84610-dce9-462f-9e37-e258fd5a5a56 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.195684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab84610-dce9-462f-9e37-e258fd5a5a56 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.196385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab84610-dce9-462f-9e37-e258fd5a5a56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:56.196728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab84610-dce9-462f-9e37-e258fd5a5a56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.198150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab84610-dce9-462f-9e37-e258fd5a5a56 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.216453 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 535/1066] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:56.218673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84610-dce9-462f-9e37-e258fd5a5a56 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.224948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d713a7ef-eaf0-4323-8a27-eef21c087b07 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.265526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478e9a-60cc-42e1-a63c-ac3e33ce17b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.266625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478e9a-60cc-42e1-a63c-ac3e33ce17b6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.266941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478e9a-60cc-42e1-a63c-ac3e33ce17b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.267608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37478e9a-60cc-42e1-a63c-ac3e33ce17b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.268305 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478e9a-60cc-42e1-a63c-ac3e33ce17b6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:56.268624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478e9a-60cc-42e1-a63c-ac3e33ce17b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.270011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37478e9a-60cc-42e1-a63c-ac3e33ce17b6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.280270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 532/1067] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:56.287375 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.288344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478e9a-60cc-42e1-a63c-ac3e33ce17b6 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.330675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab84610-dce9-462f-9e37-e258fd5a5a56 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.364905 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22862c30-6d29-4162-9255-1e7586170b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.365579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22862c30-6d29-4162-9255-1e7586170b38 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.365854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22862c30-6d29-4162-9255-1e7586170b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.366122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22862c30-6d29-4162-9255-1e7586170b38 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/c6ceb08f9eda4942a510bfaa0f0ef84e/roles/f523dfe9fc8a4caba222da4603a476ef` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.368306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22862c30-6d29-4162-9255-1e7586170b38 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=c6ceb08f9eda4942a510bfaa0f0ef84e, role_id=f523dfe9fc8a4caba222da4603a476ef)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.369806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22862c30-6d29-4162-9255-1e7586170b38 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.375506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.385667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 536/1068] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:53:56 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/c6ceb08f9eda4942a510bfaa0f0ef84e/roles/f523dfe9fc8a4caba222da4603a476ef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:53:56.410960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37478e9a-60cc-42e1-a63c-ac3e33ce17b6 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.452038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55f4b4-cb8d-4c53-93f0-4f378212209e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.452588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55f4b4-cb8d-4c53-93f0-4f378212209e None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.452864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55f4b4-cb8d-4c53-93f0-4f378212209e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.453137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f55f4b4-cb8d-4c53-93f0-4f378212209e None admin] PATH_INFO: `/v3/users/9f67c658069a43a78e27123245482cc6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.469350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55f4b4-cb8d-4c53-93f0-4f378212209e None admin] RBAC: Authorizing `identity:get_user(user_id=9f67c658069a43a78e27123245482cc6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.470871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f55f4b4-cb8d-4c53-93f0-4f378212209e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.472819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 533/1069] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/users/9f67c658069a43a78e27123245482cc6 => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:56.478758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22862c30-6d29-4162-9255-1e7586170b38 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.599958 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22862c30-6d29-4162-9255-1e7586170b38 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.620237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:56.636933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3b2fe-4b5c-4d8f-aae8-4569541f2a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.637640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3b2fe-4b5c-4d8f-aae8-4569541f2a08 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.637988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3b2fe-4b5c-4d8f-aae8-4569541f2a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.638327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d3b2fe-4b5c-4d8f-aae8-4569541f2a08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.707160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3b2fe-4b5c-4d8f-aae8-4569541f2a08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.708638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d3b2fe-4b5c-4d8f-aae8-4569541f2a08 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.816495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 537/1070] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:53:56.822599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55f4b4-cb8d-4c53-93f0-4f378212209e None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.925323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f55f4b4-cb8d-4c53-93f0-4f378212209e None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:56.960505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc27cd9-cb62-4dba-92b4-f73bd8e903aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:56.961051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc27cd9-cb62-4dba-92b4-f73bd8e903aa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:56.961364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc27cd9-cb62-4dba-92b4-f73bd8e903aa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:56.961562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc27cd9-cb62-4dba-92b4-f73bd8e903aa None admin] PATH_INFO: `/v3/projects/fff195c40e574d288d0b9a9bc06ca732` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:56.962797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc27cd9-cb62-4dba-92b4-f73bd8e903aa None admin] RBAC: Authorizing `identity:get_project(project_id=fff195c40e574d288d0b9a9bc06ca732)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:56.964531 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc27cd9-cb62-4dba-92b4-f73bd8e903aa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:56.971133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 534/1071] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/projects/fff195c40e574d288d0b9a9bc06ca732 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:56.972467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3b2fe-4b5c-4d8f-aae8-4569541f2a08 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:56.993784 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:57.079966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d3b2fe-4b5c-4d8f-aae8-4569541f2a08 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:57.115620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bfd79b-d96d-4e20-9edc-c8ed504eadb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:57.116233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfd79b-d96d-4e20-9edc-c8ed504eadb8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:57.116504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfd79b-d96d-4e20-9edc-c8ed504eadb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:57.116770 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfd79b-d96d-4e20-9edc-c8ed504eadb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:57.117488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfd79b-d96d-4e20-9edc-c8ed504eadb8 None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=fff195c40e574d288d0b9a9bc06ca732, user.id=9f67c658069a43a78e27123245482cc6) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:57.117787 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfd79b-d96d-4e20-9edc-c8ed504eadb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:57.119256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bfd79b-d96d-4e20-9edc-c8ed504eadb8 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:57.125331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 538/1072] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:53:56 2022] GET /identity/v3/role_assignments?user.id=9f67c658069a43a78e27123245482cc6&scope.project.id=fff195c40e574d288d0b9a9bc06ca732&role.id=85a146946817410b9a3addcf041c5909 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:58.045567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b1012-64a6-4e81-8839-56ab04529999 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.046086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b1012-64a6-4e81-8839-56ab04529999 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.046086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b1012-64a6-4e81-8839-56ab04529999 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.047353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 535/1073] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:58.053090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9478-fac2-43e2-b532-d9615aa7e355 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.053351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9478-fac2-43e2-b532-d9615aa7e355 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.053633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e9478-fac2-43e2-b532-d9615aa7e355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.072405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-923e9478-fac2-43e2-b532-d9615aa7e355 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:58.073669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-923e9478-fac2-43e2-b532-d9615aa7e355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:58.143913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 539/1074] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:58.378128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6901e47-df7e-459e-9ef5-635cd181a536 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.378363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6901e47-df7e-459e-9ef5-635cd181a536 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.378592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6901e47-df7e-459e-9ef5-635cd181a536 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.379937 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 536/1075] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:58.385721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f56f0-0f43-4d38-a990-8dc7e0586ffa None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.386014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f56f0-0f43-4d38-a990-8dc7e0586ffa None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.386269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561f56f0-0f43-4d38-a990-8dc7e0586ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.404125 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6901e47-df7e-459e-9ef5-635cd181a536 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.405193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-561f56f0-0f43-4d38-a990-8dc7e0586ffa None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:58.406365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-561f56f0-0f43-4d38-a990-8dc7e0586ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:58.413344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.417070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.483543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 540/1076] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:53:58.513034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6901e47-df7e-459e-9ef5-635cd181a536 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.548199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865804c5-4c17-47b4-b240-d12329bba895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.548811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865804c5-4c17-47b4-b240-d12329bba895 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.549083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865804c5-4c17-47b4-b240-d12329bba895 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.549350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865804c5-4c17-47b4-b240-d12329bba895 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.618243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865804c5-4c17-47b4-b240-d12329bba895 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.619881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865804c5-4c17-47b4-b240-d12329bba895 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.627981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.722709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 537/1077] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:53:58.728448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f56f0-0f43-4d38-a990-8dc7e0586ffa None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.749032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865804c5-4c17-47b4-b240-d12329bba895 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.852579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561f56f0-0f43-4d38-a990-8dc7e0586ffa None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.864057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865804c5-4c17-47b4-b240-d12329bba895 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:58.872775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.890070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162a712-76e7-44fa-b9cf-f2a6b6f631d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.890725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162a712-76e7-44fa-b9cf-f2a6b6f631d0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.891178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162a712-76e7-44fa-b9cf-f2a6b6f631d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.891452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d162a712-76e7-44fa-b9cf-f2a6b6f631d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.903285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162a712-76e7-44fa-b9cf-f2a6b6f631d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:58.906107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d162a712-76e7-44fa-b9cf-f2a6b6f631d0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:58.909171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:58.915490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966a2a-001c-4d77-a293-f2613334e49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:58.916145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966a2a-001c-4d77-a293-f2613334e49d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:58.916420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966a2a-001c-4d77-a293-f2613334e49d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:58.916742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4966a2a-001c-4d77-a293-f2613334e49d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-d162a712-76e7-44fa-b9cf-f2a6b6f631d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:58.923761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:58.924723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:58.926560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:58.926560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:58.926560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:58.926560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 541/1078] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:58.928944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4966a2a-001c-4d77-a293-f2613334e49d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:58.930853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162a712-76e7-44fa-b9cf-f2a6b6f631d0 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f4966a2a-001c-4d77-a293-f2613334e49d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:58.933694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:58.934816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:58.939773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 538/1079] 10.222.0.59 () {56 vars in 1120 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:58.940817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966a2a-001c-4d77-a293-f2613334e49d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.046666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4966a2a-001c-4d77-a293-f2613334e49d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.047376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d162a712-76e7-44fa-b9cf-f2a6b6f631d0 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.081443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f74c6-9cf9-4a5f-9fb4-2e5f27b910c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.082050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f74c6-9cf9-4a5f-9fb4-2e5f27b910c6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.082153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6b4bb7-1f8d-4261-bdcb-9ac83e6ea9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.082327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f74c6-9cf9-4a5f-9fb4-2e5f27b910c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.082595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f74c6-9cf9-4a5f-9fb4-2e5f27b910c6 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.082805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b4bb7-1f8d-4261-bdcb-9ac83e6ea9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.083076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b4bb7-1f8d-4261-bdcb-9ac83e6ea9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.083295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f74c6-9cf9-4a5f-9fb4-2e5f27b910c6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:59.083386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6b4bb7-1f8d-4261-bdcb-9ac83e6ea9d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.083595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f74c6-9cf9-4a5f-9fb4-2e5f27b910c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.083979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b4bb7-1f8d-4261-bdcb-9ac83e6ea9d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:59.084281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b4bb7-1f8d-4261-bdcb-9ac83e6ea9d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.084978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0f74c6-9cf9-4a5f-9fb4-2e5f27b910c6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.085640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6b4bb7-1f8d-4261-bdcb-9ac83e6ea9d2 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.093189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 539/1080] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:59.094158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a9d79-e5db-4c1c-95b6-8d9c7abd2e1a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.094436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a9d79-e5db-4c1c-95b6-8d9c7abd2e1a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.094703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a9d79-e5db-4c1c-95b6-8d9c7abd2e1a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.096058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 540/1081] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:53:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:53:59.098472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 542/1082] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:59.099002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a9d79-e5db-4c1c-95b6-8d9c7abd2e1a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.101301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235dc6-c679-46aa-be43-3fe0257a5e18 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.101589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235dc6-c679-46aa-be43-3fe0257a5e18 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.101866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72235dc6-c679-46aa-be43-3fe0257a5e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.122529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-72235dc6-c679-46aa-be43-3fe0257a5e18 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:53:59.123828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-72235dc6-c679-46aa-be43-3fe0257a5e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:53:59.143669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:59.195454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:59.217788 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 543/1083] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:53:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:53:59.237621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a9d79-e5db-4c1c-95b6-8d9c7abd2e1a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.275977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0871808-28ce-42ff-9906-c94314b17855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.276836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0871808-28ce-42ff-9906-c94314b17855 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.277016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0871808-28ce-42ff-9906-c94314b17855 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.277283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0871808-28ce-42ff-9906-c94314b17855 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.287544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0871808-28ce-42ff-9906-c94314b17855 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.288973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0871808-28ce-42ff-9906-c94314b17855 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-f0871808-28ce-42ff-9906-c94314b17855 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:53:59.304311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:59.305261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:53:59.306210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:53:59.306210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:53:59.306210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:59.306210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 541/1084] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:53:59.311775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72235dc6-c679-46aa-be43-3fe0257a5e18 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.416159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72235dc6-c679-46aa-be43-3fe0257a5e18 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.451530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcb1c3-4fc7-43f6-8e65-32d91954cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.452134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcb1c3-4fc7-43f6-8e65-32d91954cd4d None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.452410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcb1c3-4fc7-43f6-8e65-32d91954cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.452676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bcb1c3-4fc7-43f6-8e65-32d91954cd4d None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.453491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcb1c3-4fc7-43f6-8e65-32d91954cd4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:59.453610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcb1c3-4fc7-43f6-8e65-32d91954cd4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.455017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bcb1c3-4fc7-43f6-8e65-32d91954cd4d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.466410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 544/1085] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:59.472463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0871808-28ce-42ff-9906-c94314b17855 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.481499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcb1c3-4fc7-43f6-8e65-32d91954cd4d None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.530405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:59.556557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:59.576516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0871808-28ce-42ff-9906-c94314b17855 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.583696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bcb1c3-4fc7-43f6-8e65-32d91954cd4d None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.609722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69fb3-a1ca-4fd2-857d-ba884d639c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.610593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69fb3-a1ca-4fd2-857d-ba884d639c81 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.610593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69fb3-a1ca-4fd2-857d-ba884d639c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.610976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f69fb3-a1ca-4fd2-857d-ba884d639c81 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.618390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f8296-ac1c-462f-b738-08bd9d7cdd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.618659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f69fb3-a1ca-4fd2-857d-ba884d639c81 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.619057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f8296-ac1c-462f-b738-08bd9d7cdd31 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.619337 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f8296-ac1c-462f-b738-08bd9d7cdd31 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.619608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02f8296-ac1c-462f-b738-08bd9d7cdd31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.620169 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f69fb3-a1ca-4fd2-857d-ba884d639c81 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.630407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02f8296-ac1c-462f-b738-08bd9d7cdd31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-99f69fb3-a1ca-4fd2-857d-ba884d639c81 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:53:59.631306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:59.636487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:53:59.637656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 542/1086] 10.222.0.59 () {56 vars in 1093 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-f02f8296-ac1c-462f-b738-08bd9d7cdd31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:53:59.638250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:53:59.639135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:53:59.640039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 545/1087] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:53:59.640790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69fb3-a1ca-4fd2-857d-ba884d639c81 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.642063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f8296-ac1c-462f-b738-08bd9d7cdd31 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.740031 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02f8296-ac1c-462f-b738-08bd9d7cdd31 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.744488 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f69fb3-a1ca-4fd2-857d-ba884d639c81 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.747355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:59.778885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01286dbe-d590-4479-accc-8fafb7bec303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.779502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01286dbe-d590-4479-accc-8fafb7bec303 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.779775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01286dbe-d590-4479-accc-8fafb7bec303 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.780032 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01286dbe-d590-4479-accc-8fafb7bec303 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.780680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01286dbe-d590-4479-accc-8fafb7bec303 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:59.780975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01286dbe-d590-4479-accc-8fafb7bec303 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.782160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eaa4d-77f1-4731-9152-d57ece8c901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.782350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01286dbe-d590-4479-accc-8fafb7bec303 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.782800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eaa4d-77f1-4731-9152-d57ece8c901b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.783070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eaa4d-77f1-4731-9152-d57ece8c901b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.783340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95eaa4d-77f1-4731-9152-d57ece8c901b None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.784068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eaa4d-77f1-4731-9152-d57ece8c901b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:53:59.785372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eaa4d-77f1-4731-9152-d57ece8c901b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.785874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95eaa4d-77f1-4731-9152-d57ece8c901b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.792960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 546/1088] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:59.795352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:53:59.798848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01286dbe-d590-4479-accc-8fafb7bec303 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.809782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 543/1089] 10.222.0.59 () {56 vars in 1133 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:53:59.811046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eaa4d-77f1-4731-9152-d57ece8c901b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.897590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01286dbe-d590-4479-accc-8fafb7bec303 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.912856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95eaa4d-77f1-4731-9152-d57ece8c901b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:53:59.932903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad060af9-35f1-44c6-9c6b-1c2bcefea163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.933543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad060af9-35f1-44c6-9c6b-1c2bcefea163 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.933819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad060af9-35f1-44c6-9c6b-1c2bcefea163 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.934088 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad060af9-35f1-44c6-9c6b-1c2bcefea163 None admin] PATH_INFO: `/v3/users/9f67c658069a43a78e27123245482cc6` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.935254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad060af9-35f1-44c6-9c6b-1c2bcefea163 None admin] RBAC: Authorizing `identity:get_user(user_id=9f67c658069a43a78e27123245482cc6)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:53:59.936713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad060af9-35f1-44c6-9c6b-1c2bcefea163 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:53:59.938322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 547/1090] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/users/9f67c658069a43a78e27123245482cc6 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:53:59.944332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad060af9-35f1-44c6-9c6b-1c2bcefea163 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:53:59.947144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55573467-eec3-442f-a291-1c154d9a3f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:53:59.947756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55573467-eec3-442f-a291-1c154d9a3f22 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:53:59.948037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55573467-eec3-442f-a291-1c154d9a3f22 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:53:59.948299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55573467-eec3-442f-a291-1c154d9a3f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:53:59.980177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.013580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.017769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55573467-eec3-442f-a291-1c154d9a3f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.019476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55573467-eec3-442f-a291-1c154d9a3f22 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.047698 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad060af9-35f1-44c6-9c6b-1c2bcefea163 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.082866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10988ef6-80fe-41bd-85c0-244b16bbffea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.083436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10988ef6-80fe-41bd-85c0-244b16bbffea None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.083714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10988ef6-80fe-41bd-85c0-244b16bbffea None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.083986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10988ef6-80fe-41bd-85c0-244b16bbffea None admin] PATH_INFO: `/v3/projects/fff195c40e574d288d0b9a9bc06ca732` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.085095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10988ef6-80fe-41bd-85c0-244b16bbffea None admin] RBAC: Authorizing `identity:get_project(project_id=fff195c40e574d288d0b9a9bc06ca732)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.086580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10988ef6-80fe-41bd-85c0-244b16bbffea None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.088245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 548/1091] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/projects/fff195c40e574d288d0b9a9bc06ca732 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:00.094800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10988ef6-80fe-41bd-85c0-244b16bbffea None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.129617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 544/1092] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:53:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:54:00.135495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55573467-eec3-442f-a291-1c154d9a3f22 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.195024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10988ef6-80fe-41bd-85c0-244b16bbffea None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.198091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.231795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963996a2-4f36-4d52-aba8-eee146133322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.232309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.232457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963996a2-4f36-4d52-aba8-eee146133322 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.232732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963996a2-4f36-4d52-aba8-eee146133322 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.232998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963996a2-4f36-4d52-aba8-eee146133322 None admin] PATH_INFO: `/v3/projects/fff195c40e574d288d0b9a9bc06ca732/users/9f67c658069a43a78e27123245482cc6/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.234958 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963996a2-4f36-4d52-aba8-eee146133322 None admin] RBAC: Authorizing `identity:create_grant(project_id=fff195c40e574d288d0b9a9bc06ca732, user_id=9f67c658069a43a78e27123245482cc6, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.236397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963996a2-4f36-4d52-aba8-eee146133322 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.236881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55573467-eec3-442f-a291-1c154d9a3f22 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.253027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 549/1093] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:54:00 2022] PUT /identity/v3/projects/fff195c40e574d288d0b9a9bc06ca732/users/9f67c658069a43a78e27123245482cc6/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:54:00.273677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f043f-7b8a-4c95-9e6f-d5d0547f22f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.274327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f043f-7b8a-4c95-9e6f-d5d0547f22f0 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.274604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f043f-7b8a-4c95-9e6f-d5d0547f22f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.274919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938f043f-7b8a-4c95-9e6f-d5d0547f22f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.286754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f043f-7b8a-4c95-9e6f-d5d0547f22f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.288270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938f043f-7b8a-4c95-9e6f-d5d0547f22f0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-938f043f-7b8a-4c95-9e6f-d5d0547f22f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:00.304681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:00.306569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:54:00.308419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:00.308419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:54:00.308419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:54:00.308419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 545/1094] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:54:00.312449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963996a2-4f36-4d52-aba8-eee146133322 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.427615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963996a2-4f36-4d52-aba8-eee146133322 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.460102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a16a1e-c008-48ec-98db-140b9822ca44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.460720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16a1e-c008-48ec-98db-140b9822ca44 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.461000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16a1e-c008-48ec-98db-140b9822ca44 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.461271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a16a1e-c008-48ec-98db-140b9822ca44 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.461919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a16a1e-c008-48ec-98db-140b9822ca44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:00.462219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a16a1e-c008-48ec-98db-140b9822ca44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.464028 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a16a1e-c008-48ec-98db-140b9822ca44 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.475336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 550/1095] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:54:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:00.481354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f043f-7b8a-4c95-9e6f-d5d0547f22f0 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.582292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938f043f-7b8a-4c95-9e6f-d5d0547f22f0 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.615724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601a340-0f33-4d65-b321-c248882bfb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.616359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a340-0f33-4d65-b321-c248882bfb84 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.616636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a340-0f33-4d65-b321-c248882bfb84 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.616904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0601a340-0f33-4d65-b321-c248882bfb84 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.623499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601a340-0f33-4d65-b321-c248882bfb84 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.624946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0601a340-0f33-4d65-b321-c248882bfb84 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-0601a340-0f33-4d65-b321-c248882bfb84 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:54:00.636118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:00.637040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:00.637924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:54:00.637924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:54:00.637924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:54:00.637924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:54:00.637924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:54:00.637924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:54:00.637924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:54:00.637924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:54:00.637924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 546/1096] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:54:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:00.643510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a16a1e-c008-48ec-98db-140b9822ca44 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.669883 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.745818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a16a1e-c008-48ec-98db-140b9822ca44 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.783654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b193669-2927-48f1-bf34-861c52ab0f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.784280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b193669-2927-48f1-bf34-861c52ab0f10 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.784594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b193669-2927-48f1-bf34-861c52ab0f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.784862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b193669-2927-48f1-bf34-861c52ab0f10 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.785540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b193669-2927-48f1-bf34-861c52ab0f10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:00.785836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b193669-2927-48f1-bf34-861c52ab0f10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.787341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b193669-2927-48f1-bf34-861c52ab0f10 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.800012 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 551/1097] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:00.806401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601a340-0f33-4d65-b321-c248882bfb84 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:00.819682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:00.910821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0601a340-0f33-4d65-b321-c248882bfb84 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:00.945278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e10723-2f34-46b4-8347-f5210a749b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:00.945877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e10723-2f34-46b4-8347-f5210a749b7b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:00.946148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e10723-2f34-46b4-8347-f5210a749b7b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:00.946416 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e10723-2f34-46b4-8347-f5210a749b7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:00.947170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e10723-2f34-46b4-8347-f5210a749b7b None admin] RBAC: Adding query filter params (role.id=f523dfe9fc8a4caba222da4603a476ef, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=c6ceb08f9eda4942a510bfaa0f0ef84e) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:00.947472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e10723-2f34-46b4-8347-f5210a749b7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:00.949006 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e10723-2f34-46b4-8347-f5210a749b7b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:00.954991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 547/1098] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:00 2022] GET /identity/v3/role_assignments?user.id=c6ceb08f9eda4942a510bfaa0f0ef84e&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=f523dfe9fc8a4caba222da4603a476ef => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:02.175017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b17369-a21b-4258-9ad9-3bf8b47d5f19 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.175810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b17369-a21b-4258-9ad9-3bf8b47d5f19 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.175810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b17369-a21b-4258-9ad9-3bf8b47d5f19 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.177986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 552/1099] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:02.186245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a961b-e669-4067-b218-fbc00a92f2e0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.186673 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a961b-e669-4067-b218-fbc00a92f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.186852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012a961b-e669-4067-b218-fbc00a92f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.215639 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-012a961b-e669-4067-b218-fbc00a92f2e0 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:02.216825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-012a961b-e669-4067-b218-fbc00a92f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:02.288745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 548/1100] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:02.577191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b17369-a21b-4258-9ad9-3bf8b47d5f19 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.688632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:02.707822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b17369-a21b-4258-9ad9-3bf8b47d5f19 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.745744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b6d40-f62a-4159-9438-955d6e871a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.746377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b6d40-f62a-4159-9438-955d6e871a1f None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.746678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b6d40-f62a-4159-9438-955d6e871a1f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.746964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0b6d40-f62a-4159-9438-955d6e871a1f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.757924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0b6d40-f62a-4159-9438-955d6e871a1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-ad0b6d40-f62a-4159-9438-955d6e871a1f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:02.762802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:02.763880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:54:02.764854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 553/1101] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:02.770617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a961b-e669-4067-b218-fbc00a92f2e0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:02.773863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:02.871325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012a961b-e669-4067-b218-fbc00a92f2e0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:02.907329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bad506-8657-4b24-9d39-17ffb4c57613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:02.907925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad506-8657-4b24-9d39-17ffb4c57613 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:02.908194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad506-8657-4b24-9d39-17ffb4c57613 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:02.908455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bad506-8657-4b24-9d39-17ffb4c57613 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:02.909110 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bad506-8657-4b24-9d39-17ffb4c57613 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:02.909402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bad506-8657-4b24-9d39-17ffb4c57613 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:02.910754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bad506-8657-4b24-9d39-17ffb4c57613 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:02.918919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 549/1102] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:02.928442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b6d40-f62a-4159-9438-955d6e871a1f None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.055890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0b6d40-f62a-4159-9438-955d6e871a1f None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.096050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891434c-3c69-4915-85a4-91a36ce82a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.096768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891434c-3c69-4915-85a4-91a36ce82a24 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.097049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891434c-3c69-4915-85a4-91a36ce82a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.097316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891434c-3c69-4915-85a4-91a36ce82a24 None admin] PATH_INFO: `/v3/users/9f67c658069a43a78e27123245482cc6` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.098558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891434c-3c69-4915-85a4-91a36ce82a24 None admin] RBAC: Authorizing `identity:get_user(user_id=9f67c658069a43a78e27123245482cc6)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.100060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891434c-3c69-4915-85a4-91a36ce82a24 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.101670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 554/1103] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:02 2022] GET /identity/v3/users/9f67c658069a43a78e27123245482cc6 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:03.108561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bad506-8657-4b24-9d39-17ffb4c57613 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.181609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.219544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bad506-8657-4b24-9d39-17ffb4c57613 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.256938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9656-cab4-4da9-8b25-b8b976f2957d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.257537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9656-cab4-4da9-8b25-b8b976f2957d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.257815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9656-cab4-4da9-8b25-b8b976f2957d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.258090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef9656-cab4-4da9-8b25-b8b976f2957d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.328646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef9656-cab4-4da9-8b25-b8b976f2957d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.330098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef9656-cab4-4da9-8b25-b8b976f2957d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.402196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.448384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 550/1104] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:54:03.454813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891434c-3c69-4915-85a4-91a36ce82a24 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.471046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:03.568407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891434c-3c69-4915-85a4-91a36ce82a24 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.601283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42df7a08-91c7-49f4-bb4b-dc4e237d48a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.601913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7a08-91c7-49f4-bb4b-dc4e237d48a6 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.602191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7a08-91c7-49f4-bb4b-dc4e237d48a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.602460 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42df7a08-91c7-49f4-bb4b-dc4e237d48a6 None admin] PATH_INFO: `/v3/projects/fff195c40e574d288d0b9a9bc06ca732` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.603598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df7a08-91c7-49f4-bb4b-dc4e237d48a6 None admin] RBAC: Authorizing `identity:get_project(project_id=fff195c40e574d288d0b9a9bc06ca732)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.605200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42df7a08-91c7-49f4-bb4b-dc4e237d48a6 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.606880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 555/1105] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/projects/fff195c40e574d288d0b9a9bc06ca732 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:03.613485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9656-cab4-4da9-8b25-b8b976f2957d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:03.718405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef9656-cab4-4da9-8b25-b8b976f2957d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:03.753736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd95b28e-bef3-44b4-8531-7aee3432b8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:03.754330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b28e-bef3-44b4-8531-7aee3432b8fc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:03.754610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b28e-bef3-44b4-8531-7aee3432b8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:03.754903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd95b28e-bef3-44b4-8531-7aee3432b8fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:03.755631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b28e-bef3-44b4-8531-7aee3432b8fc None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=fff195c40e574d288d0b9a9bc06ca732, user.id=9f67c658069a43a78e27123245482cc6) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:03.755930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b28e-bef3-44b4-8531-7aee3432b8fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:03.757360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd95b28e-bef3-44b4-8531-7aee3432b8fc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:03.763707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 551/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:03 2022] GET /identity/v3/role_assignments?user.id=9f67c658069a43a78e27123245482cc6&scope.project.id=fff195c40e574d288d0b9a9bc06ca732&role.id=85a146946817410b9a3addcf041c5909 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:05.704986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00cb0-1b54-4200-9915-6d3d13d3a5ce None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.705580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00cb0-1b54-4200-9915-6d3d13d3a5ce None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.705580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc00cb0-1b54-4200-9915-6d3d13d3a5ce None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.706924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 556/1107] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:05.713190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fe514-a349-4abb-bf9a-2a789c67d2df None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:05.713879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fe514-a349-4abb-bf9a-2a789c67d2df None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:05.714677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4fe514-a349-4abb-bf9a-2a789c67d2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:05.740360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7b4fe514-a349-4abb-bf9a-2a789c67d2df None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:05.741568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7b4fe514-a349-4abb-bf9a-2a789c67d2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:05.767428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:05.815208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 552/1108] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:06.082898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc00cb0-1b54-4200-9915-6d3d13d3a5ce None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.179273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:06.201427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc00cb0-1b54-4200-9915-6d3d13d3a5ce None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.235949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851dd27b-5a65-45be-b835-8e27226a1567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.236582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd27b-5a65-45be-b835-8e27226a1567 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.236859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd27b-5a65-45be-b835-8e27226a1567 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.237130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851dd27b-5a65-45be-b835-8e27226a1567 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.238243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dd27b-5a65-45be-b835-8e27226a1567 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.239724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851dd27b-5a65-45be-b835-8e27226a1567 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.241332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 557/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:06.247810 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fe514-a349-4abb-bf9a-2a789c67d2df None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:06.351567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4fe514-a349-4abb-bf9a-2a789c67d2df None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:06.387538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ea36f-6ace-4c05-9971-a22387289729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:06.388143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea36f-6ace-4c05-9971-a22387289729 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:06.388418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea36f-6ace-4c05-9971-a22387289729 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:06.388685 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ea36f-6ace-4c05-9971-a22387289729 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:06.389336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ea36f-6ace-4c05-9971-a22387289729 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:06.390814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ea36f-6ace-4c05-9971-a22387289729 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:06.417044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 553/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:54:06 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:08.335145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66dc8f-ab3b-4bfc-a4b9-74bae758a16c None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.335700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66dc8f-ab3b-4bfc-a4b9-74bae758a16c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.335700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66dc8f-ab3b-4bfc-a4b9-74bae758a16c None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.337045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 558/1111] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:08.343793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f157d-725e-4efd-9722-cf4e84158a65 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.344495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f157d-725e-4efd-9722-cf4e84158a65 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.344768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83f157d-725e-4efd-9722-cf4e84158a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.374012 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e83f157d-725e-4efd-9722-cf4e84158a65 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:08.375252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e83f157d-725e-4efd-9722-cf4e84158a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:08.386530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:08.450441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 554/1112] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:08.718138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66dc8f-ab3b-4bfc-a4b9-74bae758a16c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:08.847111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66dc8f-ab3b-4bfc-a4b9-74bae758a16c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:08.882501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c594aa1-7743-4e2a-b587-41c839dc13db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:08.883179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c594aa1-7743-4e2a-b587-41c839dc13db None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:08.883455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c594aa1-7743-4e2a-b587-41c839dc13db None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:08.883727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c594aa1-7743-4e2a-b587-41c839dc13db None admin] PATH_INFO: `/v3/roles/17053af642bb46de91cf75f9be9d458a` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:08.885168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c594aa1-7743-4e2a-b587-41c839dc13db None admin] RBAC: Authorizing `identity:get_role(role_id=17053af642bb46de91cf75f9be9d458a)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:08.886611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c594aa1-7743-4e2a-b587-41c839dc13db None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:08.887982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 559/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:08 2022] GET /identity/v3/roles/17053af642bb46de91cf75f9be9d458a => generated 223 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:08.897842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f157d-725e-4efd-9722-cf4e84158a65 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.007915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83f157d-725e-4efd-9722-cf4e84158a65 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.047598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bda3fa-a093-486e-8ed8-78625e36774d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.048220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda3fa-a093-486e-8ed8-78625e36774d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.048495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda3fa-a093-486e-8ed8-78625e36774d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.048763 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bda3fa-a093-486e-8ed8-78625e36774d None admin] PATH_INFO: `/v3/users/2075b51e4be8470f91da2c0470a9253d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.062540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bda3fa-a093-486e-8ed8-78625e36774d None admin] RBAC: Authorizing `identity:get_user(user_id=2075b51e4be8470f91da2c0470a9253d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.064029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5bda3fa-a093-486e-8ed8-78625e36774d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.065648 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 555/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:08 2022] GET /identity/v3/users/2075b51e4be8470f91da2c0470a9253d => generated 286 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:09.072375 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c594aa1-7743-4e2a-b587-41c839dc13db None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.098652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.189161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c594aa1-7743-4e2a-b587-41c839dc13db None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.224519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f07e3-a185-4fd3-be26-448412f78cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.225129 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f07e3-a185-4fd3-be26-448412f78cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.225406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f07e3-a185-4fd3-be26-448412f78cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.225676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f07e3-a185-4fd3-be26-448412f78cd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.294981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f07e3-a185-4fd3-be26-448412f78cd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.296363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f07e3-a185-4fd3-be26-448412f78cd1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.313271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.410377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 560/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:54:09.416986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bda3fa-a093-486e-8ed8-78625e36774d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.421456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.526326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bda3fa-a093-486e-8ed8-78625e36774d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.561883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c554d5-8b3f-4b9f-953c-06adea3f34a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.562453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c554d5-8b3f-4b9f-953c-06adea3f34a3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.562730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c554d5-8b3f-4b9f-953c-06adea3f34a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.563037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c554d5-8b3f-4b9f-953c-06adea3f34a3 None admin] PATH_INFO: `/v3/projects/fff195c40e574d288d0b9a9bc06ca732` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.564344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c554d5-8b3f-4b9f-953c-06adea3f34a3 None admin] RBAC: Authorizing `identity:get_project(project_id=fff195c40e574d288d0b9a9bc06ca732)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.565816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c554d5-8b3f-4b9f-953c-06adea3f34a3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.567526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 556/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/projects/fff195c40e574d288d0b9a9bc06ca732 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:09.575144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f07e3-a185-4fd3-be26-448412f78cd1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:09.692611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f07e3-a185-4fd3-be26-448412f78cd1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:09.709472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:09.730176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8fa16-e1c0-4ecd-a864-384e99b45372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:09.730881 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fa16-e1c0-4ecd-a864-384e99b45372 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:09.731172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fa16-e1c0-4ecd-a864-384e99b45372 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:09.731445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8fa16-e1c0-4ecd-a864-384e99b45372 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:09.732176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8fa16-e1c0-4ecd-a864-384e99b45372 None admin] RBAC: Adding query filter params (role.id=17053af642bb46de91cf75f9be9d458a, scope.project.id=fff195c40e574d288d0b9a9bc06ca732, user.id=2075b51e4be8470f91da2c0470a9253d) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:09.732486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8fa16-e1c0-4ecd-a864-384e99b45372 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:09.733929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c8fa16-e1c0-4ecd-a864-384e99b45372 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:09.739329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 561/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:09 2022] GET /identity/v3/role_assignments?user.id=2075b51e4be8470f91da2c0470a9253d&scope.project.id=fff195c40e574d288d0b9a9bc06ca732&role.id=17053af642bb46de91cf75f9be9d458a => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:54:11.623156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e2a52-f3ea-4b27-a6d7-d132c000482c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.624139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e2a52-f3ea-4b27-a6d7-d132c000482c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.624139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504e2a52-f3ea-4b27-a6d7-d132c000482c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.626107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 557/1118] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:11.635185 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcf569-f1b8-407c-9fcd-b86dea1c9a15 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:11.635711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcf569-f1b8-407c-9fcd-b86dea1c9a15 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:11.636100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adcf569-f1b8-407c-9fcd-b86dea1c9a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:11.657760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-0adcf569-f1b8-407c-9fcd-b86dea1c9a15 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:11.659005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0adcf569-f1b8-407c-9fcd-b86dea1c9a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:11.730711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 562/1119] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:12.001238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e2a52-f3ea-4b27-a6d7-d132c000482c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.091519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:12.135301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504e2a52-f3ea-4b27-a6d7-d132c000482c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.171856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58b8f5-ee40-4ef6-8f93-062cfa3b088c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.172469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b8f5-ee40-4ef6-8f93-062cfa3b088c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.172741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b8f5-ee40-4ef6-8f93-062cfa3b088c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.173005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58b8f5-ee40-4ef6-8f93-062cfa3b088c None admin] PATH_INFO: `/v3/roles/17053af642bb46de91cf75f9be9d458a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.174424 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58b8f5-ee40-4ef6-8f93-062cfa3b088c None admin] RBAC: Authorizing `identity:get_role(role_id=17053af642bb46de91cf75f9be9d458a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.175820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58b8f5-ee40-4ef6-8f93-062cfa3b088c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.177141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 558/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:11 2022] GET /identity/v3/roles/17053af642bb46de91cf75f9be9d458a => generated 223 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:12.183709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcf569-f1b8-407c-9fcd-b86dea1c9a15 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.295144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adcf569-f1b8-407c-9fcd-b86dea1c9a15 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.306192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:12.332777 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66725a83-59a8-4da9-a608-811edd437aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.333408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66725a83-59a8-4da9-a608-811edd437aa1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.333690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66725a83-59a8-4da9-a608-811edd437aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.333962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66725a83-59a8-4da9-a608-811edd437aa1 None admin] PATH_INFO: `/v3/users/2075b51e4be8470f91da2c0470a9253d` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.335170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66725a83-59a8-4da9-a608-811edd437aa1 None admin] RBAC: Authorizing `identity:get_user(user_id=2075b51e4be8470f91da2c0470a9253d)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.336611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66725a83-59a8-4da9-a608-811edd437aa1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.338189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 563/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:12 2022] GET /identity/v3/users/2075b51e4be8470f91da2c0470a9253d => generated 286 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:12.344365 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58b8f5-ee40-4ef6-8f93-062cfa3b088c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.452307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58b8f5-ee40-4ef6-8f93-062cfa3b088c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.496838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20065440-11da-4db0-b89e-6e449d468a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.497470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20065440-11da-4db0-b89e-6e449d468a6b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.497746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20065440-11da-4db0-b89e-6e449d468a6b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.498020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20065440-11da-4db0-b89e-6e449d468a6b None admin] PATH_INFO: `/v3/projects/fff195c40e574d288d0b9a9bc06ca732` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.499251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20065440-11da-4db0-b89e-6e449d468a6b None admin] RBAC: Authorizing `identity:get_project(project_id=fff195c40e574d288d0b9a9bc06ca732)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.500681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20065440-11da-4db0-b89e-6e449d468a6b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.502348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 559/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:54:12 2022] GET /identity/v3/projects/fff195c40e574d288d0b9a9bc06ca732 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:12.508766 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66725a83-59a8-4da9-a608-811edd437aa1 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:12.615636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66725a83-59a8-4da9-a608-811edd437aa1 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:12.655928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c503848-d09e-4f97-b13e-b63308f5d957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:12.656890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c503848-d09e-4f97-b13e-b63308f5d957 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:12.657295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c503848-d09e-4f97-b13e-b63308f5d957 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:12.657708 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c503848-d09e-4f97-b13e-b63308f5d957 None admin] PATH_INFO: `/v3/projects/fff195c40e574d288d0b9a9bc06ca732/users/2075b51e4be8470f91da2c0470a9253d/roles/17053af642bb46de91cf75f9be9d458a` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:12.661912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c503848-d09e-4f97-b13e-b63308f5d957 None admin] RBAC: Authorizing `identity:create_grant(project_id=fff195c40e574d288d0b9a9bc06ca732, user_id=2075b51e4be8470f91da2c0470a9253d, role_id=17053af642bb46de91cf75f9be9d458a)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:12.664415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c503848-d09e-4f97-b13e-b63308f5d957 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:12.681092 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 564/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:54:12 2022] PUT /identity/v3/projects/fff195c40e574d288d0b9a9bc06ca732/users/2075b51e4be8470f91da2c0470a9253d/roles/17053af642bb46de91cf75f9be9d458a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:14.548351 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bba4b3-9a65-4a69-9c77-ef61cea1a74c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.549230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bba4b3-9a65-4a69-9c77-ef61cea1a74c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.549230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bba4b3-9a65-4a69-9c77-ef61cea1a74c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.551510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 560/1124] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:14.557029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947ab7a-2a94-46ad-96e4-24eed69b507b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:14.557452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947ab7a-2a94-46ad-96e4-24eed69b507b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:14.557558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1947ab7a-2a94-46ad-96e4-24eed69b507b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:14.576487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-1947ab7a-2a94-46ad-96e4-24eed69b507b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:14.577665 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-1947ab7a-2a94-46ad-96e4-24eed69b507b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:14.609980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:14.650323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 565/1125] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:14.916883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bba4b3-9a65-4a69-9c77-ef61cea1a74c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:14.929400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:15.035741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bba4b3-9a65-4a69-9c77-ef61cea1a74c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.090322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4ecc3-b193-4be5-a840-efd65ee4af0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.090991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4ecc3-b193-4be5-a840-efd65ee4af0d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.091267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4ecc3-b193-4be5-a840-efd65ee4af0d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.091532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f4ecc3-b193-4be5-a840-efd65ee4af0d None admin] PATH_INFO: `/v3/roles/17053af642bb46de91cf75f9be9d458a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.093111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4ecc3-b193-4be5-a840-efd65ee4af0d None admin] RBAC: Authorizing `identity:get_role(role_id=17053af642bb46de91cf75f9be9d458a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.095039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f4ecc3-b193-4be5-a840-efd65ee4af0d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.097211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 561/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:14 2022] GET /identity/v3/roles/17053af642bb46de91cf75f9be9d458a => generated 223 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:15.107001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947ab7a-2a94-46ad-96e4-24eed69b507b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:15.232138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1947ab7a-2a94-46ad-96e4-24eed69b507b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.271758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d81d6-cc06-4aae-8d87-766ae3903d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.272382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d81d6-cc06-4aae-8d87-766ae3903d53 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.272657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d81d6-cc06-4aae-8d87-766ae3903d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.272930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612d81d6-cc06-4aae-8d87-766ae3903d53 None admin] PATH_INFO: `/v3/users/2075b51e4be8470f91da2c0470a9253d` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.274106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d81d6-cc06-4aae-8d87-766ae3903d53 None admin] RBAC: Authorizing `identity:get_user(user_id=2075b51e4be8470f91da2c0470a9253d)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.275580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612d81d6-cc06-4aae-8d87-766ae3903d53 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.277213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 566/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:15 2022] GET /identity/v3/users/2075b51e4be8470f91da2c0470a9253d => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:15.283849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4ecc3-b193-4be5-a840-efd65ee4af0d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:15.372489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:15.402945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f4ecc3-b193-4be5-a840-efd65ee4af0d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.441659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679efe4-4226-4d0c-b8bf-dbf2b1c03c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.442250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679efe4-4226-4d0c-b8bf-dbf2b1c03c91 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.442522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679efe4-4226-4d0c-b8bf-dbf2b1c03c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.442795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679efe4-4226-4d0c-b8bf-dbf2b1c03c91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.511239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679efe4-4226-4d0c-b8bf-dbf2b1c03c91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.512605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a679efe4-4226-4d0c-b8bf-dbf2b1c03c91 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.592389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:15.618637 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 562/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:54:15.628340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d81d6-cc06-4aae-8d87-766ae3903d53 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:15.670678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:15.738574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612d81d6-cc06-4aae-8d87-766ae3903d53 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.778057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc600311-2cf3-48ca-9898-fa69fa8a24a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.778705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600311-2cf3-48ca-9898-fa69fa8a24a1 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.779153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600311-2cf3-48ca-9898-fa69fa8a24a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.779427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc600311-2cf3-48ca-9898-fa69fa8a24a1 None admin] PATH_INFO: `/v3/projects/fff195c40e574d288d0b9a9bc06ca732` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.780713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc600311-2cf3-48ca-9898-fa69fa8a24a1 None admin] RBAC: Authorizing `identity:get_project(project_id=fff195c40e574d288d0b9a9bc06ca732)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.782182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc600311-2cf3-48ca-9898-fa69fa8a24a1 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.783902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 567/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:54:15 2022] GET /identity/v3/projects/fff195c40e574d288d0b9a9bc06ca732 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:15.793560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679efe4-4226-4d0c-b8bf-dbf2b1c03c91 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:15.911892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679efe4-4226-4d0c-b8bf-dbf2b1c03c91 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:15.958213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfce373-a077-4bfb-b775-28fc40224b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:15.959095 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfce373-a077-4bfb-b775-28fc40224b0c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:15.959481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfce373-a077-4bfb-b775-28fc40224b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:15.959815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfce373-a077-4bfb-b775-28fc40224b0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:15.960933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfce373-a077-4bfb-b775-28fc40224b0c None admin] RBAC: Adding query filter params (role.id=17053af642bb46de91cf75f9be9d458a, scope.project.id=fff195c40e574d288d0b9a9bc06ca732, user.id=2075b51e4be8470f91da2c0470a9253d) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:15.961356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfce373-a077-4bfb-b775-28fc40224b0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:15.963862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfce373-a077-4bfb-b775-28fc40224b0c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:15.970081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 563/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:15 2022] GET /identity/v3/role_assignments?user.id=2075b51e4be8470f91da2c0470a9253d&scope.project.id=fff195c40e574d288d0b9a9bc06ca732&role.id=17053af642bb46de91cf75f9be9d458a => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:17.906857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b624-3225-4f33-9afb-733308cd04c3 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.907394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b624-3225-4f33-9afb-733308cd04c3 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.907394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d0b624-3225-4f33-9afb-733308cd04c3 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.909497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 568/1131] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:17 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:17.914943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e234-dac1-4c99-bbf2-52720ccd980b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:17.915316 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e234-dac1-4c99-bbf2-52720ccd980b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:17.915491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e6e234-dac1-4c99-bbf2-52720ccd980b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:17.939012 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a7e6e234-dac1-4c99-bbf2-52720ccd980b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:17.940191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a7e6e234-dac1-4c99-bbf2-52720ccd980b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:17.985141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:18.027670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 564/1132] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:18.294213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b624-3225-4f33-9afb-733308cd04c3 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.411376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d0b624-3225-4f33-9afb-733308cd04c3 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.413740 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:18.460179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265918cd-fb81-4b6e-abcb-3579c95b7340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.460816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265918cd-fb81-4b6e-abcb-3579c95b7340 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.461088 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265918cd-fb81-4b6e-abcb-3579c95b7340 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.461354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265918cd-fb81-4b6e-abcb-3579c95b7340 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.462522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265918cd-fb81-4b6e-abcb-3579c95b7340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.464084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265918cd-fb81-4b6e-abcb-3579c95b7340 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.465690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 569/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:18.471807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6e234-dac1-4c99-bbf2-52720ccd980b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:18.573131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e6e234-dac1-4c99-bbf2-52720ccd980b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:18.611161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af360a00-f6a4-4e29-91e6-42939b96372e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:18.611756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af360a00-f6a4-4e29-91e6-42939b96372e None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:18.612038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af360a00-f6a4-4e29-91e6-42939b96372e None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:18.612297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af360a00-f6a4-4e29-91e6-42939b96372e None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:18.612936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af360a00-f6a4-4e29-91e6-42939b96372e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:18.614344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af360a00-f6a4-4e29-91e6-42939b96372e None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:18.649323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 565/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:54:18 2022] POST /identity/v3/projects => generated 311 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:20.561736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb70ab-9f6f-4596-a587-a5c2c21de20d None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:20.562629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb70ab-9f6f-4596-a587-a5c2c21de20d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:20.562629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fb70ab-9f6f-4596-a587-a5c2c21de20d None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:20.564873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 570/1135] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:20.573774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c4d91-580a-4104-8aa7-2189767e279a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:20.574218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c4d91-580a-4104-8aa7-2189767e279a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:20.574311 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014c4d91-580a-4104-8aa7-2189767e279a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:20.593724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-014c4d91-580a-4104-8aa7-2189767e279a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:20.594945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-014c4d91-580a-4104-8aa7-2189767e279a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:20.612341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:20.673856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 566/1136] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:20.945053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb70ab-9f6f-4596-a587-a5c2c21de20d None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:21.060143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fb70ab-9f6f-4596-a587-a5c2c21de20d None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:21.104219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cc7203-0216-4b55-a312-6d262625b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:21.104851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7203-0216-4b55-a312-6d262625b960 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.105121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7203-0216-4b55-a312-6d262625b960 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.105383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cc7203-0216-4b55-a312-6d262625b960 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:21.106654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc7203-0216-4b55-a312-6d262625b960 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:21.108144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cc7203-0216-4b55-a312-6d262625b960 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:21.109716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 571/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:54:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:21.119096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c4d91-580a-4104-8aa7-2189767e279a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:21.230662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014c4d91-580a-4104-8aa7-2189767e279a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:21.266972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546e4076-ccf9-4329-955d-474ad2b9bd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:21.267569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e4076-ccf9-4329-955d-474ad2b9bd96 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:21.267843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e4076-ccf9-4329-955d-474ad2b9bd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:21.268074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546e4076-ccf9-4329-955d-474ad2b9bd96 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:21.268727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e4076-ccf9-4329-955d-474ad2b9bd96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:21.270486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546e4076-ccf9-4329-955d-474ad2b9bd96 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:21.299186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 567/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:54:21 2022] POST /identity/v3/users => generated 286 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:23.215718 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af098611-3a80-45fe-95bb-8ece170c1974 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.216535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af098611-3a80-45fe-95bb-8ece170c1974 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.216535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af098611-3a80-45fe-95bb-8ece170c1974 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.218600 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 572/1139] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:23.227515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dd5ca-e3c9-4ab6-bee1-60555d36ae35 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.227954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dd5ca-e3c9-4ab6-bee1-60555d36ae35 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.228111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1dd5ca-e3c9-4ab6-bee1-60555d36ae35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.253135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dd1dd5ca-e3c9-4ab6-bee1-60555d36ae35 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:23.254318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dd1dd5ca-e3c9-4ab6-bee1-60555d36ae35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:23.256268 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.328491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 568/1140] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:23.597808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af098611-3a80-45fe-95bb-8ece170c1974 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.647931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.709460 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af098611-3a80-45fe-95bb-8ece170c1974 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.746433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e66b2-7414-48d1-95e0-756ce3c2b565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.747149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e66b2-7414-48d1-95e0-756ce3c2b565 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.747424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e66b2-7414-48d1-95e0-756ce3c2b565 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.747700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e66b2-7414-48d1-95e0-756ce3c2b565 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.758673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e66b2-7414-48d1-95e0-756ce3c2b565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-083e66b2-7414-48d1-95e0-756ce3c2b565 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:23.763379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:23.764505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:23.765556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:54:23.766583 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 573/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:23.771016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dd5ca-e3c9-4ab6-bee1-60555d36ae35 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:23.892495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1dd5ca-e3c9-4ab6-bee1-60555d36ae35 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:23.934218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96f53e-36fe-41bc-927c-260f67601b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:23.934828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96f53e-36fe-41bc-927c-260f67601b41 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:23.935136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96f53e-36fe-41bc-927c-260f67601b41 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:23.935402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96f53e-36fe-41bc-927c-260f67601b41 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:23.936073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96f53e-36fe-41bc-927c-260f67601b41 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:23.936375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96f53e-36fe-41bc-927c-260f67601b41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:23.937750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb96f53e-36fe-41bc-927c-260f67601b41 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:23.943040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:23.948558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 569/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:23.955447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e66b2-7414-48d1-95e0-756ce3c2b565 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.058925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:24.062177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e66b2-7414-48d1-95e0-756ce3c2b565 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.101517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcf898-0ab1-4bab-8b7c-4466c74764eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.102246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcf898-0ab1-4bab-8b7c-4466c74764eb None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.102519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcf898-0ab1-4bab-8b7c-4466c74764eb None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.102804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abcf898-0ab1-4bab-8b7c-4466c74764eb None admin] PATH_INFO: `/v3/users/9986a8b3414245ee997901ff0e692dda` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.117990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcf898-0ab1-4bab-8b7c-4466c74764eb None admin] RBAC: Authorizing `identity:get_user(user_id=9986a8b3414245ee997901ff0e692dda)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.119605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abcf898-0ab1-4bab-8b7c-4466c74764eb None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.121225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 574/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:23 2022] GET /identity/v3/users/9986a8b3414245ee997901ff0e692dda => generated 286 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:24.127576 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96f53e-36fe-41bc-927c-260f67601b41 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.234046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96f53e-36fe-41bc-927c-260f67601b41 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.268785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e2ae-5423-4a91-8aa8-b4614ede6d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.269381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e2ae-5423-4a91-8aa8-b4614ede6d93 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.269656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e2ae-5423-4a91-8aa8-b4614ede6d93 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.269922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c248e2ae-5423-4a91-8aa8-b4614ede6d93 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.336770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:24.339790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e2ae-5423-4a91-8aa8-b4614ede6d93 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.342089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c248e2ae-5423-4a91-8aa8-b4614ede6d93 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.444261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 570/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:54:24.452303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcf898-0ab1-4bab-8b7c-4466c74764eb None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.571531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abcf898-0ab1-4bab-8b7c-4466c74764eb None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.613665 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8100a3-511a-4dfa-acc2-ce1d42b92421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.614630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8100a3-511a-4dfa-acc2-ce1d42b92421 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.615083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8100a3-511a-4dfa-acc2-ce1d42b92421 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.615516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8100a3-511a-4dfa-acc2-ce1d42b92421 None admin] PATH_INFO: `/v3/projects/c1263d63ac0c45daa5375c1da21da216` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.617589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8100a3-511a-4dfa-acc2-ce1d42b92421 None admin] RBAC: Authorizing `identity:get_project(project_id=c1263d63ac0c45daa5375c1da21da216)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.620082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8100a3-511a-4dfa-acc2-ce1d42b92421 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.622837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 575/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:54:24 2022] GET /identity/v3/projects/c1263d63ac0c45daa5375c1da21da216 => generated 311 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:24.629765 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e2ae-5423-4a91-8aa8-b4614ede6d93 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:24.737470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:24.740795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c248e2ae-5423-4a91-8aa8-b4614ede6d93 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:24.777483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950ff266-a800-41a7-8883-03cf5b260124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:24.778086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ff266-a800-41a7-8883-03cf5b260124 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:24.778364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ff266-a800-41a7-8883-03cf5b260124 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:24.778634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950ff266-a800-41a7-8883-03cf5b260124 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:24.779396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ff266-a800-41a7-8883-03cf5b260124 None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=c1263d63ac0c45daa5375c1da21da216, user.id=9986a8b3414245ee997901ff0e692dda) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:24.779701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ff266-a800-41a7-8883-03cf5b260124 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:24.781147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950ff266-a800-41a7-8883-03cf5b260124 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:24.786809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 571/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:24 2022] GET /identity/v3/role_assignments?user.id=9986a8b3414245ee997901ff0e692dda&scope.project.id=c1263d63ac0c45daa5375c1da21da216&role.id=85a146946817410b9a3addcf041c5909 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:26.655828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642694-1c42-4627-826d-069d5f16a505 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.656724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642694-1c42-4627-826d-069d5f16a505 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.656724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df642694-1c42-4627-826d-069d5f16a505 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.658888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 576/1147] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:26.667405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8d748-edfc-4102-910b-8112dbdae52c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:26.667866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8d748-edfc-4102-910b-8112dbdae52c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:26.667960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f8d748-edfc-4102-910b-8112dbdae52c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:26.687787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-35f8d748-edfc-4102-910b-8112dbdae52c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:26.688968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-35f8d748-edfc-4102-910b-8112dbdae52c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:26.760497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 572/1148] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:54:27.046003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df642694-1c42-4627-826d-069d5f16a505 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.079761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:27.158426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df642694-1c42-4627-826d-069d5f16a505 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.194317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c72c7e-91ca-40d8-a37a-ec77eb41dbea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.194959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c72c7e-91ca-40d8-a37a-ec77eb41dbea None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.195235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c72c7e-91ca-40d8-a37a-ec77eb41dbea None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.195507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c72c7e-91ca-40d8-a37a-ec77eb41dbea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.206037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c72c7e-91ca-40d8-a37a-ec77eb41dbea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-c0c72c7e-91ca-40d8-a37a-ec77eb41dbea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:27.210669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:27.211832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:54:27.213074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 577/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:54:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:27.220961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8d748-edfc-4102-910b-8112dbdae52c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.326073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:27.333707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f8d748-edfc-4102-910b-8112dbdae52c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.369237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13cd3a-ddcc-4be0-aa6b-2dc0b3f67b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.369910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13cd3a-ddcc-4be0-aa6b-2dc0b3f67b33 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.370188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13cd3a-ddcc-4be0-aa6b-2dc0b3f67b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.370455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13cd3a-ddcc-4be0-aa6b-2dc0b3f67b33 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.371152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13cd3a-ddcc-4be0-aa6b-2dc0b3f67b33 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:27.371447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13cd3a-ddcc-4be0-aa6b-2dc0b3f67b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.372811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13cd3a-ddcc-4be0-aa6b-2dc0b3f67b33 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.380913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 573/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:27.387268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c72c7e-91ca-40d8-a37a-ec77eb41dbea None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.488645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:27.506558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c72c7e-91ca-40d8-a37a-ec77eb41dbea None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.543111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401f722-13c1-4a88-8886-d3e76c8e2e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.543746 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401f722-13c1-4a88-8886-d3e76c8e2e67 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.544022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401f722-13c1-4a88-8886-d3e76c8e2e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.544269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401f722-13c1-4a88-8886-d3e76c8e2e67 None admin] PATH_INFO: `/v3/users/9986a8b3414245ee997901ff0e692dda` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.545443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401f722-13c1-4a88-8886-d3e76c8e2e67 None admin] RBAC: Authorizing `identity:get_user(user_id=9986a8b3414245ee997901ff0e692dda)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.546911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e401f722-13c1-4a88-8886-d3e76c8e2e67 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.548503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 578/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:27 2022] GET /identity/v3/users/9986a8b3414245ee997901ff0e692dda => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:27.557688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13cd3a-ddcc-4be0-aa6b-2dc0b3f67b33 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.670873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13cd3a-ddcc-4be0-aa6b-2dc0b3f67b33 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.704803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce73e11-ca1a-4fef-b13a-a1f3d329d6a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.705408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce73e11-ca1a-4fef-b13a-a1f3d329d6a4 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.705681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce73e11-ca1a-4fef-b13a-a1f3d329d6a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.705946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce73e11-ca1a-4fef-b13a-a1f3d329d6a4 None admin] PATH_INFO: `/v3/projects/c1263d63ac0c45daa5375c1da21da216` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.707206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce73e11-ca1a-4fef-b13a-a1f3d329d6a4 None admin] RBAC: Authorizing `identity:get_project(project_id=c1263d63ac0c45daa5375c1da21da216)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.708633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce73e11-ca1a-4fef-b13a-a1f3d329d6a4 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.710268 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 574/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:54:27 2022] GET /identity/v3/projects/c1263d63ac0c45daa5375c1da21da216 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:27.717132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401f722-13c1-4a88-8886-d3e76c8e2e67 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:27.834656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e401f722-13c1-4a88-8886-d3e76c8e2e67 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:27.869801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06877eff-d66b-471c-8b47-eb8d61a90402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:27.870446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06877eff-d66b-471c-8b47-eb8d61a90402 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:27.870721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06877eff-d66b-471c-8b47-eb8d61a90402 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:27.871007 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06877eff-d66b-471c-8b47-eb8d61a90402 None admin] PATH_INFO: `/v3/projects/c1263d63ac0c45daa5375c1da21da216/users/9986a8b3414245ee997901ff0e692dda/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:27.873133 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06877eff-d66b-471c-8b47-eb8d61a90402 None admin] RBAC: Authorizing `identity:create_grant(project_id=c1263d63ac0c45daa5375c1da21da216, user_id=9986a8b3414245ee997901ff0e692dda, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:27.874560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06877eff-d66b-471c-8b47-eb8d61a90402 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:27.897087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 579/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:54:27 2022] PUT /identity/v3/projects/c1263d63ac0c45daa5375c1da21da216/users/9986a8b3414245ee997901ff0e692dda/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:29.781157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457a353-e80f-43cb-a587-b5a80012a9e4 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.781635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457a353-e80f-43cb-a587-b5a80012a9e4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.781725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457a353-e80f-43cb-a587-b5a80012a9e4 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.783793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 575/1154] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:29.791632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b4feb-64f2-4c67-b307-1b1a2de55369 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:29.792119 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b4feb-64f2-4c67-b307-1b1a2de55369 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:29.792436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550b4feb-64f2-4c67-b307-1b1a2de55369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:29.811636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-550b4feb-64f2-4c67-b307-1b1a2de55369 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:29.812832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-550b4feb-64f2-4c67-b307-1b1a2de55369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:29.822096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:29.882958 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 580/1155] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:30.151696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457a353-e80f-43cb-a587-b5a80012a9e4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:30.178888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:30.257088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457a353-e80f-43cb-a587-b5a80012a9e4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:30.297060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134061f3-1b89-4d60-abf9-b21e46121b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:30.297676 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134061f3-1b89-4d60-abf9-b21e46121b81 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.297954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134061f3-1b89-4d60-abf9-b21e46121b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.298223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134061f3-1b89-4d60-abf9-b21e46121b81 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.310034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134061f3-1b89-4d60-abf9-b21e46121b81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-134061f3-1b89-4d60-abf9-b21e46121b81 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:30.314751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:30.315811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:54:30.316774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 576/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:54:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:30.322724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b4feb-64f2-4c67-b307-1b1a2de55369 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:30.428217 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550b4feb-64f2-4c67-b307-1b1a2de55369 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:30.463020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1304a8-8448-4355-837d-98c1240daef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:30.463835 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1304a8-8448-4355-837d-98c1240daef8 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.464115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1304a8-8448-4355-837d-98c1240daef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.464357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1304a8-8448-4355-837d-98c1240daef8 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.465030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1304a8-8448-4355-837d-98c1240daef8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:30.465322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1304a8-8448-4355-837d-98c1240daef8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:30.466695 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1304a8-8448-4355-837d-98c1240daef8 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:30.475675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 581/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:30.482060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134061f3-1b89-4d60-abf9-b21e46121b81 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:30.573913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:30.597145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134061f3-1b89-4d60-abf9-b21e46121b81 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:30.636923 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6cb1c-37c6-44a3-b285-8027425a9dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:30.637543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6cb1c-37c6-44a3-b285-8027425a9dcf None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.637817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6cb1c-37c6-44a3-b285-8027425a9dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.638092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6cb1c-37c6-44a3-b285-8027425a9dcf None admin] PATH_INFO: `/v3/users/9986a8b3414245ee997901ff0e692dda` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.639375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6cb1c-37c6-44a3-b285-8027425a9dcf None admin] RBAC: Authorizing `identity:get_user(user_id=9986a8b3414245ee997901ff0e692dda)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:30.640809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d6cb1c-37c6-44a3-b285-8027425a9dcf None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:30.642445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 577/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:30 2022] GET /identity/v3/users/9986a8b3414245ee997901ff0e692dda => generated 286 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:30.649865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1304a8-8448-4355-837d-98c1240daef8 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:30.665935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:30.768602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1304a8-8448-4355-837d-98c1240daef8 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:30.807825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2fda-62c1-429b-bcc1-a3007f552151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:30.808404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2fda-62c1-429b-bcc1-a3007f552151 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:30.808689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2fda-62c1-429b-bcc1-a3007f552151 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:30.808949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcb2fda-62c1-429b-bcc1-a3007f552151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:30.878326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb2fda-62c1-429b-bcc1-a3007f552151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:30.879804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcb2fda-62c1-429b-bcc1-a3007f552151 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:30.887506 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:30.993199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 582/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:54:30.999605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6cb1c-37c6-44a3-b285-8027425a9dcf None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:31.103143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d6cb1c-37c6-44a3-b285-8027425a9dcf None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:31.139216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c896699-0dc1-4c1d-8db3-a99d2bdb8fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:31.139831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c896699-0dc1-4c1d-8db3-a99d2bdb8fa9 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:31.140110 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c896699-0dc1-4c1d-8db3-a99d2bdb8fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:31.140379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c896699-0dc1-4c1d-8db3-a99d2bdb8fa9 None admin] PATH_INFO: `/v3/projects/c1263d63ac0c45daa5375c1da21da216` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:31.141498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c896699-0dc1-4c1d-8db3-a99d2bdb8fa9 None admin] RBAC: Authorizing `identity:get_project(project_id=c1263d63ac0c45daa5375c1da21da216)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:31.142969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c896699-0dc1-4c1d-8db3-a99d2bdb8fa9 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:31.144668 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 578/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:54:30 2022] GET /identity/v3/projects/c1263d63ac0c45daa5375c1da21da216 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:31.156058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2fda-62c1-429b-bcc1-a3007f552151 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:31.299284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcb2fda-62c1-429b-bcc1-a3007f552151 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:31.307249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:31.336592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b83021-c8d0-478f-8cc3-5d56f07a3f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:31.337216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83021-c8d0-478f-8cc3-5d56f07a3f33 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:31.337495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83021-c8d0-478f-8cc3-5d56f07a3f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:31.337763 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b83021-c8d0-478f-8cc3-5d56f07a3f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:31.338515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83021-c8d0-478f-8cc3-5d56f07a3f33 None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=c1263d63ac0c45daa5375c1da21da216, user.id=9986a8b3414245ee997901ff0e692dda) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:31.338819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83021-c8d0-478f-8cc3-5d56f07a3f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:31.340417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b83021-c8d0-478f-8cc3-5d56f07a3f33 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:31.346285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 583/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:31 2022] GET /identity/v3/role_assignments?user.id=9986a8b3414245ee997901ff0e692dda&scope.project.id=c1263d63ac0c45daa5375c1da21da216&role.id=85a146946817410b9a3addcf041c5909 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:33.263288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fe012-2d4b-4989-9c5a-3a2f4f7d0858 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.264187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fe012-2d4b-4989-9c5a-3a2f4f7d0858 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.264187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fe012-2d4b-4989-9c5a-3a2f4f7d0858 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.266383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 579/1162] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:33.275486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c05c37-503f-4b0b-a132-9bacb55112b6 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.276505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c05c37-503f-4b0b-a132-9bacb55112b6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.276505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c05c37-503f-4b0b-a132-9bacb55112b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.306711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-81c05c37-503f-4b0b-a132-9bacb55112b6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:33.308095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-81c05c37-503f-4b0b-a132-9bacb55112b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:33.384583 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 584/1163] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:33.672643 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fe012-2d4b-4989-9c5a-3a2f4f7d0858 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:33.702296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:33.808774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fe012-2d4b-4989-9c5a-3a2f4f7d0858 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:33.848382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8dc4-f701-47ca-8349-9626662cc8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:33.848987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8dc4-f701-47ca-8349-9626662cc8aa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:33.849265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8dc4-f701-47ca-8349-9626662cc8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:33.849538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400f8dc4-f701-47ca-8349-9626662cc8aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:33.952261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f8dc4-f701-47ca-8349-9626662cc8aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:33.954408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400f8dc4-f701-47ca-8349-9626662cc8aa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:33.983341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.082164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 580/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:54:34.089759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c05c37-503f-4b0b-a132-9bacb55112b6 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:34.236949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.240522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c05c37-503f-4b0b-a132-9bacb55112b6 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.284348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5575480-c2b8-493c-827e-8890484eb011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.285072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5575480-c2b8-493c-827e-8890484eb011 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.285299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5575480-c2b8-493c-827e-8890484eb011 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.285564 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5575480-c2b8-493c-827e-8890484eb011 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.294196 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5575480-c2b8-493c-827e-8890484eb011 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.295964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5575480-c2b8-493c-827e-8890484eb011 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-c5575480-c2b8-493c-827e-8890484eb011 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:34.311758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:34.313017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:54:34.314165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 585/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Aug 18 20:54:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:34.319783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8dc4-f701-47ca-8349-9626662cc8aa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:34.445214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400f8dc4-f701-47ca-8349-9626662cc8aa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:34.472806 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:34.492357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb774a29-e47d-46d9-a567-f135885249af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:34.492884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb774a29-e47d-46d9-a567-f135885249af None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:34.493166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb774a29-e47d-46d9-a567-f135885249af None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:34.493445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb774a29-e47d-46d9-a567-f135885249af None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:34.494077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb774a29-e47d-46d9-a567-f135885249af None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:34.494407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb774a29-e47d-46d9-a567-f135885249af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:34.496873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb774a29-e47d-46d9-a567-f135885249af None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:34.507148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 581/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Thu Aug 18 20:54:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:36.386441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72058d1-8945-44c3-9e2f-e9296110b585 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.387066 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72058d1-8945-44c3-9e2f-e9296110b585 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.387066 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72058d1-8945-44c3-9e2f-e9296110b585 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.388477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 586/1167] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:36.394830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58d3a7-7b9c-473c-83c1-811bc2807a67 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.395940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58d3a7-7b9c-473c-83c1-811bc2807a67 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.396077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58d3a7-7b9c-473c-83c1-811bc2807a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.423346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ca58d3a7-7b9c-473c-83c1-811bc2807a67 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:36.424537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca58d3a7-7b9c-473c-83c1-811bc2807a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:36.495633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 582/1168] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:36.765289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72058d1-8945-44c3-9e2f-e9296110b585 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:36.885987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72058d1-8945-44c3-9e2f-e9296110b585 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:36.929711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e1c33-e795-4d38-9e1d-2b8fa98dfe1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:36.930510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e1c33-e795-4d38-9e1d-2b8fa98dfe1b None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:36.930801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e1c33-e795-4d38-9e1d-2b8fa98dfe1b None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:36.931085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e1c33-e795-4d38-9e1d-2b8fa98dfe1b None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:36.932061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e1c33-e795-4d38-9e1d-2b8fa98dfe1b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:36.933615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e1c33-e795-4d38-9e1d-2b8fa98dfe1b None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:36.951769 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 587/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Thu Aug 18 20:54:36 2022] POST /identity/v3/domains => generated 267 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:38.850497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ab21-6712-4fb6-95a5-acb0e3c6a172 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:38.851373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ab21-6712-4fb6-95a5-acb0e3c6a172 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:38.851373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de90ab21-6712-4fb6-95a5-acb0e3c6a172 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:38.853870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 583/1170] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:38.859518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632f4c6-7cc7-4f9a-b9b4-36f91a4cdd56 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:38.859926 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632f4c6-7cc7-4f9a-b9b4-36f91a4cdd56 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:38.860031 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f632f4c6-7cc7-4f9a-b9b4-36f91a4cdd56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:38.879538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-f632f4c6-7cc7-4f9a-b9b4-36f91a4cdd56 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:38.880813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f632f4c6-7cc7-4f9a-b9b4-36f91a4cdd56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:38.895270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:38.956115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 588/1171] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:39.224557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ab21-6712-4fb6-95a5-acb0e3c6a172 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:39.362233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de90ab21-6712-4fb6-95a5-acb0e3c6a172 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:39.386261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:39.420760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fbd9d4-7ff4-4c43-9ea5-82bbde91d64a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:39.421390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbd9d4-7ff4-4c43-9ea5-82bbde91d64a None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:39.421671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbd9d4-7ff4-4c43-9ea5-82bbde91d64a None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:39.421941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fbd9d4-7ff4-4c43-9ea5-82bbde91d64a None admin] PATH_INFO: `/v3/domains/a3de88c8be194634bbda8cc83bfb570e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:39.432893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbd9d4-7ff4-4c43-9ea5-82bbde91d64a None admin] RBAC: Authorizing `identity:get_domain(domain_id=a3de88c8be194634bbda8cc83bfb570e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:39.434316 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fbd9d4-7ff4-4c43-9ea5-82bbde91d64a None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:39.435990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 584/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Thu Aug 18 20:54:39 2022] GET /identity/v3/domains/a3de88c8be194634bbda8cc83bfb570e => generated 267 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:39.442162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632f4c6-7cc7-4f9a-b9b4-36f91a4cdd56 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:39.547139 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f632f4c6-7cc7-4f9a-b9b4-36f91a4cdd56 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:39.592368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b931bef4-16f4-464f-945d-27cfbede8f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:39.592985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931bef4-16f4-464f-945d-27cfbede8f1a None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:39.593265 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931bef4-16f4-464f-945d-27cfbede8f1a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:39.593537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b931bef4-16f4-464f-945d-27cfbede8f1a None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:39.594230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931bef4-16f4-464f-945d-27cfbede8f1a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:39.595710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b931bef4-16f4-464f-945d-27cfbede8f1a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:39.625947 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 589/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:54:39 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:41.595630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e8a1-1c03-42a9-9a5a-dddd3c046be4 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:41.596574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e8a1-1c03-42a9-9a5a-dddd3c046be4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:41.596574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf87e8a1-1c03-42a9-9a5a-dddd3c046be4 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:41.598761 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 585/1174] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:41.605515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac9a4-b1eb-4669-a37a-0cee20de9cc3 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:41.606101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac9a4-b1eb-4669-a37a-0cee20de9cc3 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:41.606261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1ac9a4-b1eb-4669-a37a-0cee20de9cc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:41.616847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:41.636971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-6c1ac9a4-b1eb-4669-a37a-0cee20de9cc3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:41.638178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6c1ac9a4-b1eb-4669-a37a-0cee20de9cc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:41.715136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 590/1175] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:41.984960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e8a1-1c03-42a9-9a5a-dddd3c046be4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:42.106044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf87e8a1-1c03-42a9-9a5a-dddd3c046be4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:42.159135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d0b78f-6f6b-47d8-b8ec-d300ad0a549b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:42.159810 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b78f-6f6b-47d8-b8ec-d300ad0a549b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:42.160086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b78f-6f6b-47d8-b8ec-d300ad0a549b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:42.160409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b78f-6f6b-47d8-b8ec-d300ad0a549b None admin] PATH_INFO: `/v3/domains/a3de88c8be194634bbda8cc83bfb570e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:42.161615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0b78f-6f6b-47d8-b8ec-d300ad0a549b None admin] RBAC: Authorizing `identity:get_domain(domain_id=a3de88c8be194634bbda8cc83bfb570e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:42.163084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d0b78f-6f6b-47d8-b8ec-d300ad0a549b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:42.164675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 586/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Thu Aug 18 20:54:41 2022] GET /identity/v3/domains/a3de88c8be194634bbda8cc83bfb570e => generated 267 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:42.171231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ac9a4-b1eb-4669-a37a-0cee20de9cc3 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:42.287767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1ac9a4-b1eb-4669-a37a-0cee20de9cc3 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:42.321121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:42.328707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe000821-28d6-49c6-9457-08f0d6172f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:42.329330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000821-28d6-49c6-9457-08f0d6172f5f None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:42.329610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000821-28d6-49c6-9457-08f0d6172f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:42.329878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe000821-28d6-49c6-9457-08f0d6172f5f None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:42.330509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe000821-28d6-49c6-9457-08f0d6172f5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:42.332019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe000821-28d6-49c6-9457-08f0d6172f5f None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:42.355272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 591/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:54:42 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:54:44.297560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7f79-fb39-420d-a5c2-8e7ec250c5e3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:44.298457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7f79-fb39-420d-a5c2-8e7ec250c5e3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:44.298457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7f79-fb39-420d-a5c2-8e7ec250c5e3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:44.300601 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 587/1178] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:44.309994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6936b4f-6f0c-4489-bf27-8859b805c0f2 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:44.310415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6936b4f-6f0c-4489-bf27-8859b805c0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:44.310544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6936b4f-6f0c-4489-bf27-8859b805c0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:44.338976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-f6936b4f-6f0c-4489-bf27-8859b805c0f2 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:44.340177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f6936b4f-6f0c-4489-bf27-8859b805c0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:44.411777 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 592/1179] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:44.674087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b7f79-fb39-420d-a5c2-8e7ec250c5e3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:44.725382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:44.788769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b7f79-fb39-420d-a5c2-8e7ec250c5e3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:44.835019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c9de-ac9a-427c-8032-31caff8719e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:44.835644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c9de-ac9a-427c-8032-31caff8719e7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:44.835921 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c9de-ac9a-427c-8032-31caff8719e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:44.836193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab38c9de-ac9a-427c-8032-31caff8719e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:44.847731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab38c9de-ac9a-427c-8032-31caff8719e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ab38c9de-ac9a-427c-8032-31caff8719e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:44.852437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:44.853664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:54:44.854882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 588/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:54:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:44.861459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6936b4f-6f0c-4489-bf27-8859b805c0f2 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:44.971913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6936b4f-6f0c-4489-bf27-8859b805c0f2 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:44.989930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:45.009266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84298b35-133f-4244-86c2-7f761a192b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.009903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84298b35-133f-4244-86c2-7f761a192b54 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.010183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84298b35-133f-4244-86c2-7f761a192b54 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.010456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84298b35-133f-4244-86c2-7f761a192b54 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.011148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84298b35-133f-4244-86c2-7f761a192b54 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:45.011455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84298b35-133f-4244-86c2-7f761a192b54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.012840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84298b35-133f-4244-86c2-7f761a192b54 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.021559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 593/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:45.029397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c9de-ac9a-427c-8032-31caff8719e7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.140434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab38c9de-ac9a-427c-8032-31caff8719e7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.142457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:45.189972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98603b08-ae97-499c-82c7-20da956ac3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.190603 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98603b08-ae97-499c-82c7-20da956ac3aa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.190891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98603b08-ae97-499c-82c7-20da956ac3aa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.191156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98603b08-ae97-499c-82c7-20da956ac3aa None admin] PATH_INFO: `/v3/users/24f7371e03634615a8597334b2bbf3a8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.206760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98603b08-ae97-499c-82c7-20da956ac3aa None admin] RBAC: Authorizing `identity:get_user(user_id=24f7371e03634615a8597334b2bbf3a8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.208240 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98603b08-ae97-499c-82c7-20da956ac3aa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.209868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 589/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:45 2022] GET /identity/v3/users/24f7371e03634615a8597334b2bbf3a8 => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:45.217024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84298b35-133f-4244-86c2-7f761a192b54 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.335531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84298b35-133f-4244-86c2-7f761a192b54 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.370685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8de489-b824-41f0-b807-7a17bc623a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.371317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8de489-b824-41f0-b807-7a17bc623a53 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.371594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8de489-b824-41f0-b807-7a17bc623a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.371863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8de489-b824-41f0-b807-7a17bc623a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.423147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:45.447907 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8de489-b824-41f0-b807-7a17bc623a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.449433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8de489-b824-41f0-b807-7a17bc623a53 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.559962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 594/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:54:45.569580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98603b08-ae97-499c-82c7-20da956ac3aa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.676613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98603b08-ae97-499c-82c7-20da956ac3aa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.712024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b23e3b8-bd94-48c4-a266-c2b84eb91c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.712658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e3b8-bd94-48c4-a266-c2b84eb91c07 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.712959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e3b8-bd94-48c4-a266-c2b84eb91c07 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.713224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b23e3b8-bd94-48c4-a266-c2b84eb91c07 None admin] PATH_INFO: `/v3/projects/eaf64e150d114924a3c60ad1202ec09b` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.714493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23e3b8-bd94-48c4-a266-c2b84eb91c07 None admin] RBAC: Authorizing `identity:get_project(project_id=eaf64e150d114924a3c60ad1202ec09b)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.716008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b23e3b8-bd94-48c4-a266-c2b84eb91c07 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.717653 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 590/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:54:45 2022] GET /identity/v3/projects/eaf64e150d114924a3c60ad1202ec09b => generated 361 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:45.724614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8de489-b824-41f0-b807-7a17bc623a53 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:45.829334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:45.852736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8de489-b824-41f0-b807-7a17bc623a53 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:45.887745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5723142-b6ad-4367-b83d-1d801bc01941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:45.888359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723142-b6ad-4367-b83d-1d801bc01941 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:45.888633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723142-b6ad-4367-b83d-1d801bc01941 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:45.888901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5723142-b6ad-4367-b83d-1d801bc01941 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:45.889627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5723142-b6ad-4367-b83d-1d801bc01941 None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=eaf64e150d114924a3c60ad1202ec09b, user.id=24f7371e03634615a8597334b2bbf3a8) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:45.889949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5723142-b6ad-4367-b83d-1d801bc01941 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:45.891422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5723142-b6ad-4367-b83d-1d801bc01941 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:45.897776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 595/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:45 2022] GET /identity/v3/role_assignments?user.id=24f7371e03634615a8597334b2bbf3a8&scope.project.id=eaf64e150d114924a3c60ad1202ec09b&role.id=85a146946817410b9a3addcf041c5909 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:47.771148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e006c-2953-43fe-8c5b-a94934cf8c80 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:47.771675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e006c-2953-43fe-8c5b-a94934cf8c80 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:47.771675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679e006c-2953-43fe-8c5b-a94934cf8c80 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:47.773087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 591/1186] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:47.781936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27f27d-770e-4110-9201-39168195cf2f None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:47.782362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27f27d-770e-4110-9201-39168195cf2f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:47.782507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e27f27d-770e-4110-9201-39168195cf2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:47.806435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-3e27f27d-770e-4110-9201-39168195cf2f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:47.807732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3e27f27d-770e-4110-9201-39168195cf2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:47.880514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 596/1187] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:48.146159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e006c-2953-43fe-8c5b-a94934cf8c80 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:48.183006 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:48.275981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679e006c-2953-43fe-8c5b-a94934cf8c80 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:48.332827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd4ba-c405-4c7c-8e49-a2704968b2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:48.333511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd4ba-c405-4c7c-8e49-a2704968b2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:48.333786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd4ba-c405-4c7c-8e49-a2704968b2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:48.334050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8fd4ba-c405-4c7c-8e49-a2704968b2c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:48.346566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8fd4ba-c405-4c7c-8e49-a2704968b2c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-6c8fd4ba-c405-4c7c-8e49-a2704968b2c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:48.351318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:48.352385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:54:48.353283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 592/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:54:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:48.359222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27f27d-770e-4110-9201-39168195cf2f None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:48.435609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:48.462700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e27f27d-770e-4110-9201-39168195cf2f None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:48.497369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae1408-9ee0-4d13-99b4-d80a77a39380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:48.497957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae1408-9ee0-4d13-99b4-d80a77a39380 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:48.498231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae1408-9ee0-4d13-99b4-d80a77a39380 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:48.498489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fae1408-9ee0-4d13-99b4-d80a77a39380 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:48.499177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae1408-9ee0-4d13-99b4-d80a77a39380 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:48.499472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae1408-9ee0-4d13-99b4-d80a77a39380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:48.500872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fae1408-9ee0-4d13-99b4-d80a77a39380 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:48.508876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 597/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:48.515667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd4ba-c405-4c7c-8e49-a2704968b2c2 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:48.608551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:48.628890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8fd4ba-c405-4c7c-8e49-a2704968b2c2 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:48.666109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8560c-c11b-4dee-8dd0-ae6cc5e0ccb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:48.666737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8560c-c11b-4dee-8dd0-ae6cc5e0ccb7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:48.667070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8560c-c11b-4dee-8dd0-ae6cc5e0ccb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:48.667528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe8560c-c11b-4dee-8dd0-ae6cc5e0ccb7 None admin] PATH_INFO: `/v3/users/24f7371e03634615a8597334b2bbf3a8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:48.668740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8560c-c11b-4dee-8dd0-ae6cc5e0ccb7 None admin] RBAC: Authorizing `identity:get_user(user_id=24f7371e03634615a8597334b2bbf3a8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:48.670221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe8560c-c11b-4dee-8dd0-ae6cc5e0ccb7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:48.671866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 593/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:48 2022] GET /identity/v3/users/24f7371e03634615a8597334b2bbf3a8 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:48.680511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae1408-9ee0-4d13-99b4-d80a77a39380 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:48.788030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fae1408-9ee0-4d13-99b4-d80a77a39380 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:48.824514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa14942-2178-412f-aed4-1bfe712fa41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:48.825155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa14942-2178-412f-aed4-1bfe712fa41c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:48.825424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa14942-2178-412f-aed4-1bfe712fa41c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:48.825689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa14942-2178-412f-aed4-1bfe712fa41c None admin] PATH_INFO: `/v3/projects/eaf64e150d114924a3c60ad1202ec09b` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:48.826976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa14942-2178-412f-aed4-1bfe712fa41c None admin] RBAC: Authorizing `identity:get_project(project_id=eaf64e150d114924a3c60ad1202ec09b)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:48.828397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa14942-2178-412f-aed4-1bfe712fa41c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:48.830071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 598/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:54:48 2022] GET /identity/v3/projects/eaf64e150d114924a3c60ad1202ec09b => generated 361 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:48.836558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8560c-c11b-4dee-8dd0-ae6cc5e0ccb7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:48.960769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe8560c-c11b-4dee-8dd0-ae6cc5e0ccb7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:48.997288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9b90f8-3c8d-432c-91d2-60c1996e9b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:48.997937 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b90f8-3c8d-432c-91d2-60c1996e9b8d None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:48.998211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b90f8-3c8d-432c-91d2-60c1996e9b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:48.998480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9b90f8-3c8d-432c-91d2-60c1996e9b8d None admin] PATH_INFO: `/v3/projects/eaf64e150d114924a3c60ad1202ec09b/users/24f7371e03634615a8597334b2bbf3a8/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:49.000764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b90f8-3c8d-432c-91d2-60c1996e9b8d None admin] RBAC: Authorizing `identity:create_grant(project_id=eaf64e150d114924a3c60ad1202ec09b, user_id=24f7371e03634615a8597334b2bbf3a8, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:49.002226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9b90f8-3c8d-432c-91d2-60c1996e9b8d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:49.021835 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 594/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:54:48 2022] PUT /identity/v3/projects/eaf64e150d114924a3c60ad1202ec09b/users/24f7371e03634615a8597334b2bbf3a8/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:54:50.884833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492b9b3-4db4-44f2-8b0f-d926eb11a40f None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:50.885676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492b9b3-4db4-44f2-8b0f-d926eb11a40f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:50.885676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6492b9b3-4db4-44f2-8b0f-d926eb11a40f None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:50.888528 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 599/1193] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:54:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:54:50.895236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dce68-3ae0-483c-b858-d7319457291a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:50.895917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dce68-3ae0-483c-b858-d7319457291a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:50.896059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003dce68-3ae0-483c-b858-d7319457291a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:50.923290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-003dce68-3ae0-483c-b858-d7319457291a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:54:50.924491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-003dce68-3ae0-483c-b858-d7319457291a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:54:50.935660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:50.997077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 595/1194] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:54:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:54:51.275192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492b9b3-4db4-44f2-8b0f-d926eb11a40f None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:51.282329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:51.389155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6492b9b3-4db4-44f2-8b0f-d926eb11a40f None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:51.426966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c89e-3547-4f0c-a65d-b5c09a3c2d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:51.427596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c89e-3547-4f0c-a65d-b5c09a3c2d27 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:51.427871 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c89e-3547-4f0c-a65d-b5c09a3c2d27 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:51.428135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e180c89e-3547-4f0c-a65d-b5c09a3c2d27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:51.438304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e180c89e-3547-4f0c-a65d-b5c09a3c2d27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-e180c89e-3547-4f0c-a65d-b5c09a3c2d27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:54:51.443005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:54:51.443964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:54:51.444821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 600/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:54:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:54:51.450614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dce68-3ae0-483c-b858-d7319457291a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:51.555274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003dce68-3ae0-483c-b858-d7319457291a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:51.591801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0311-5ee5-441b-bbb6-014a99130e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:51.592399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0311-5ee5-441b-bbb6-014a99130e9c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:51.592673 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0311-5ee5-441b-bbb6-014a99130e9c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:51.592942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135c0311-5ee5-441b-bbb6-014a99130e9c None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:51.593606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c0311-5ee5-441b-bbb6-014a99130e9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:51.593903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c0311-5ee5-441b-bbb6-014a99130e9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:51.595337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135c0311-5ee5-441b-bbb6-014a99130e9c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:51.604231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 596/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:54:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:51.610996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c89e-3547-4f0c-a65d-b5c09a3c2d27 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:51.683354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:51.728021 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e180c89e-3547-4f0c-a65d-b5c09a3c2d27 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:51.763882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d354ef-e9ca-454f-a92d-6fdb0eb4de91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:51.764525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d354ef-e9ca-454f-a92d-6fdb0eb4de91 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:51.764803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d354ef-e9ca-454f-a92d-6fdb0eb4de91 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:51.765073 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d354ef-e9ca-454f-a92d-6fdb0eb4de91 None admin] PATH_INFO: `/v3/users/24f7371e03634615a8597334b2bbf3a8` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:51.766320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d354ef-e9ca-454f-a92d-6fdb0eb4de91 None admin] RBAC: Authorizing `identity:get_user(user_id=24f7371e03634615a8597334b2bbf3a8)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:51.767859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d354ef-e9ca-454f-a92d-6fdb0eb4de91 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:51.769527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 601/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Thu Aug 18 20:54:51 2022] GET /identity/v3/users/24f7371e03634615a8597334b2bbf3a8 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:51.776166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0311-5ee5-441b-bbb6-014a99130e9c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:51.788151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:51.883354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135c0311-5ee5-441b-bbb6-014a99130e9c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:51.919667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e923f-7836-42a6-9050-48652600ad53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:51.920263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e923f-7836-42a6-9050-48652600ad53 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:51.920535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e923f-7836-42a6-9050-48652600ad53 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:51.920805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8e923f-7836-42a6-9050-48652600ad53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:51.990915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e923f-7836-42a6-9050-48652600ad53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:51.992439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8e923f-7836-42a6-9050-48652600ad53 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:52.002305 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:52.100784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 597/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:54:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:54:52.107603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d354ef-e9ca-454f-a92d-6fdb0eb4de91 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:52.224689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d354ef-e9ca-454f-a92d-6fdb0eb4de91 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:52.258667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:52.265040 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc835a9-96bb-4cbd-99b2-91f85fa6b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:52.265683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc835a9-96bb-4cbd-99b2-91f85fa6b721 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:52.265959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc835a9-96bb-4cbd-99b2-91f85fa6b721 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:52.266255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc835a9-96bb-4cbd-99b2-91f85fa6b721 None admin] PATH_INFO: `/v3/projects/eaf64e150d114924a3c60ad1202ec09b` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:52.267433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc835a9-96bb-4cbd-99b2-91f85fa6b721 None admin] RBAC: Authorizing `identity:get_project(project_id=eaf64e150d114924a3c60ad1202ec09b)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:52.268895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc835a9-96bb-4cbd-99b2-91f85fa6b721 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:52.270884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 602/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Thu Aug 18 20:54:52 2022] GET /identity/v3/projects/eaf64e150d114924a3c60ad1202ec09b => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:54:52.277396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e923f-7836-42a6-9050-48652600ad53 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:54:52.401449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8e923f-7836-42a6-9050-48652600ad53 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:54:52.412656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:54:52.438878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd003bf-4715-4bac-8718-64d43931bf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:54:52.439478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd003bf-4715-4bac-8718-64d43931bf16 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:54:52.439754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd003bf-4715-4bac-8718-64d43931bf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:54:52.440023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd003bf-4715-4bac-8718-64d43931bf16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:54:52.440738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd003bf-4715-4bac-8718-64d43931bf16 None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=eaf64e150d114924a3c60ad1202ec09b, user.id=24f7371e03634615a8597334b2bbf3a8) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:54:52.441042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd003bf-4715-4bac-8718-64d43931bf16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:54:52.442467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd003bf-4715-4bac-8718-64d43931bf16 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:54:52.448140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 598/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:54:52 2022] GET /identity/v3/role_assignments?user.id=24f7371e03634615a8597334b2bbf3a8&scope.project.id=eaf64e150d114924a3c60ad1202ec09b&role.id=85a146946817410b9a3addcf041c5909 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:02.445640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=14 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:48.142931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89f25b-247e-4c66-acca-190e5375c5b6 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:48.143577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89f25b-247e-4c66-acca-190e5375c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:48.143577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a89f25b-247e-4c66-acca-190e5375c5b6 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:48.145123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 603/1201] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:55:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:55:48.154409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e0e47-5be8-4922-afb4-0bd84ff24139 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:48.154409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e0e47-5be8-4922-afb4-0bd84ff24139 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:48.154409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e0e47-5be8-4922-afb4-0bd84ff24139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:48.174838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-490e0e47-5be8-4922-afb4-0bd84ff24139 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:48.176296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-490e0e47-5be8-4922-afb4-0bd84ff24139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:48.260836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 599/1202] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:55:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:55:48.525565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89f25b-247e-4c66-acca-190e5375c5b6 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:48.655564 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a89f25b-247e-4c66-acca-190e5375c5b6 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:48.705172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736223e7-826f-4216-9860-9772e575f979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:48.705848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736223e7-826f-4216-9860-9772e575f979 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:48.706110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736223e7-826f-4216-9860-9772e575f979 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:48.706383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736223e7-826f-4216-9860-9772e575f979 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:48.718363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736223e7-826f-4216-9860-9772e575f979 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:48.720199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736223e7-826f-4216-9860-9772e575f979 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-736223e7-826f-4216-9860-9772e575f979 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:55:48.737812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:48.738962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:55:48.739977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:55:48.739977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:55:48.739977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:55:48.747407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 604/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:55:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:55:48.747578 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e0e47-5be8-4922-afb4-0bd84ff24139 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:48.886017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e0e47-5be8-4922-afb4-0bd84ff24139 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:48.923188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:48.931773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da9f82-8b57-4bc4-8786-58a12674c4a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:48.932875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da9f82-8b57-4bc4-8786-58a12674c4a6 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:48.933381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da9f82-8b57-4bc4-8786-58a12674c4a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:48.933651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da9f82-8b57-4bc4-8786-58a12674c4a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:48.934332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da9f82-8b57-4bc4-8786-58a12674c4a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:48.934615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da9f82-8b57-4bc4-8786-58a12674c4a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:48.936039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32da9f82-8b57-4bc4-8786-58a12674c4a6 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:48.952998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 600/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:55:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:48.959066 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736223e7-826f-4216-9860-9772e575f979 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:49.033130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:49.103539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736223e7-826f-4216-9860-9772e575f979 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:49.147888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1645af6-8430-4a9c-9cf4-7aa1f0d113b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:49.149953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645af6-8430-4a9c-9cf4-7aa1f0d113b0 None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:49.150487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645af6-8430-4a9c-9cf4-7aa1f0d113b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:49.151076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1645af6-8430-4a9c-9cf4-7aa1f0d113b0 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:49.151993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1645af6-8430-4a9c-9cf4-7aa1f0d113b0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:49.153614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1645af6-8430-4a9c-9cf4-7aa1f0d113b0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:49.178038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 605/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Thu Aug 18 20:55:48 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 20:55:51.418871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2ab24-ba14-4e21-8888-0800ffffd510 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:51.419442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2ab24-ba14-4e21-8888-0800ffffd510 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:51.419442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f2ab24-ba14-4e21-8888-0800ffffd510 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:51.420730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 601/1206] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:55:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:55:51.426142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caf3fc-fe5c-4350-bd58-8e953c0f1696 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:51.426699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caf3fc-fe5c-4350-bd58-8e953c0f1696 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:51.426699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00caf3fc-fe5c-4350-bd58-8e953c0f1696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:51.446205 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-00caf3fc-fe5c-4350-bd58-8e953c0f1696 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:51.447479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-00caf3fc-fe5c-4350-bd58-8e953c0f1696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:51.518816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 606/1207] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:55:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:55:51.790666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2ab24-ba14-4e21-8888-0800ffffd510 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:51.928029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f2ab24-ba14-4e21-8888-0800ffffd510 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:51.969793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff644b-30f1-47e7-b125-e8610374ce9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:51.970498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff644b-30f1-47e7-b125-e8610374ce9d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:51.970794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff644b-30f1-47e7-b125-e8610374ce9d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:51.971148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cff644b-30f1-47e7-b125-e8610374ce9d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:51.983804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cff644b-30f1-47e7-b125-e8610374ce9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5cff644b-30f1-47e7-b125-e8610374ce9d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:55:51.988885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:51.989912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:55:51.990764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 602/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:55:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:55:51.996426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caf3fc-fe5c-4350-bd58-8e953c0f1696 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:52.039686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:52.103542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00caf3fc-fe5c-4350-bd58-8e953c0f1696 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:52.142182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb027-8026-4ab0-b365-a055f3032197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:52.142853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb027-8026-4ab0-b365-a055f3032197 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:52.143144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb027-8026-4ab0-b365-a055f3032197 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:52.143404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37fb027-8026-4ab0-b365-a055f3032197 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:52.144484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fb027-8026-4ab0-b365-a055f3032197 None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:52.144798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fb027-8026-4ab0-b365-a055f3032197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:52.146277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37fb027-8026-4ab0-b365-a055f3032197 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:52.156610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 607/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:55:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:52.163343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff644b-30f1-47e7-b125-e8610374ce9d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:52.230474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:52.291370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cff644b-30f1-47e7-b125-e8610374ce9d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:52.335044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af27795-291e-492e-a2d6-13e1b17ebf6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:52.335686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af27795-291e-492e-a2d6-13e1b17ebf6b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:52.335961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af27795-291e-492e-a2d6-13e1b17ebf6b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:52.336253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af27795-291e-492e-a2d6-13e1b17ebf6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:52.349273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af27795-291e-492e-a2d6-13e1b17ebf6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:52.351213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af27795-291e-492e-a2d6-13e1b17ebf6b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-2af27795-291e-492e-a2d6-13e1b17ebf6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:55:52.368888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:52.370200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:55:52.371621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:55:52.371621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:55:52.371621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:55:52.371621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 603/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:55:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:55:52.379188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb027-8026-4ab0-b365-a055f3032197 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:52.489276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:52.493534 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37fb027-8026-4ab0-b365-a055f3032197 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:52.534348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec1bc-52c8-4675-8aa4-8e7cc5c27250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:52.535927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec1bc-52c8-4675-8aa4-8e7cc5c27250 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:52.535927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec1bc-52c8-4675-8aa4-8e7cc5c27250 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:52.535927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec1bc-52c8-4675-8aa4-8e7cc5c27250 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:52.537242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fec1bc-52c8-4675-8aa4-8e7cc5c27250 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:52.537654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fec1bc-52c8-4675-8aa4-8e7cc5c27250 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:52.539151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fec1bc-52c8-4675-8aa4-8e7cc5c27250 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:52.559421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 608/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:55:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:52.559584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af27795-291e-492e-a2d6-13e1b17ebf6b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:52.674184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af27795-291e-492e-a2d6-13e1b17ebf6b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:52.676749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:52.711857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3afd-6924-4e5b-b5aa-0bfe8d59d5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:52.712566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3afd-6924-4e5b-b5aa-0bfe8d59d5fa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:52.712843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3afd-6924-4e5b-b5aa-0bfe8d59d5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:52.713107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c3afd-6924-4e5b-b5aa-0bfe8d59d5fa None admin] PATH_INFO: `/v3/users/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:52.720870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c3afd-6924-4e5b-b5aa-0bfe8d59d5fa None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:52.722423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c3afd-6924-4e5b-b5aa-0bfe8d59d5fa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-ec6c3afd-6924-4e5b-b5aa-0bfe8d59d5fa None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:55:52.734782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:52.735936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:55:52.736914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 604/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:55:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:55:52.742376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec1bc-52c8-4675-8aa4-8e7cc5c27250 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:52.875742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec1bc-52c8-4675-8aa4-8e7cc5c27250 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:52.917770 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ef44-36ec-4609-85ff-549717ebd750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:52.918573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ef44-36ec-4609-85ff-549717ebd750 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:52.918972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ef44-36ec-4609-85ff-549717ebd750 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:52.919288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b321ef44-36ec-4609-85ff-549717ebd750 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:52.920320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321ef44-36ec-4609-85ff-549717ebd750 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:52.920737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321ef44-36ec-4609-85ff-549717ebd750 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:52.925620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b321ef44-36ec-4609-85ff-549717ebd750 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:52.947663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 609/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Aug 18 20:55:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:52.954605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3afd-6924-4e5b-b5aa-0bfe8d59d5fa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:53.072342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c3afd-6924-4e5b-b5aa-0bfe8d59d5fa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:53.122685 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a1a2c-9c17-455f-9723-820f3b450797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:53.123367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a1a2c-9c17-455f-9723-820f3b450797 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:53.123660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a1a2c-9c17-455f-9723-820f3b450797 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:53.123931 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23a1a2c-9c17-455f-9723-820f3b450797 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:53.161479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:53.212216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a1a2c-9c17-455f-9723-820f3b450797 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:53.213925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a23a1a2c-9c17-455f-9723-820f3b450797 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:53.335574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 605/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:55:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:55:53.343970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ef44-36ec-4609-85ff-549717ebd750 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:53.375236 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:53.481494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b321ef44-36ec-4609-85ff-549717ebd750 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:53.520965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286e0a-b654-4daf-a187-efe917e4eded None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:53.521675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286e0a-b654-4daf-a187-efe917e4eded None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:53.521925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286e0a-b654-4daf-a187-efe917e4eded None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:53.522136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8286e0a-b654-4daf-a187-efe917e4eded None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:53.535023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8286e0a-b654-4daf-a187-efe917e4eded None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:53.536893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8286e0a-b654-4daf-a187-efe917e4eded None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-f8286e0a-b654-4daf-a187-efe917e4eded None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:55:53.555925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:53.556959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:55:53.557934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:55:53.557934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:55:53.557934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:55:53.557934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 610/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:55:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:55:53.565214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a1a2c-9c17-455f-9723-820f3b450797 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:53.630237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:53.678629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a23a1a2c-9c17-455f-9723-820f3b450797 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:53.718349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542a4df-fd30-4ff7-b059-88fc9a901b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:53.719154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542a4df-fd30-4ff7-b059-88fc9a901b88 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:53.719581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542a4df-fd30-4ff7-b059-88fc9a901b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:53.719923 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5542a4df-fd30-4ff7-b059-88fc9a901b88 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:53.720584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542a4df-fd30-4ff7-b059-88fc9a901b88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:53.720893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542a4df-fd30-4ff7-b059-88fc9a901b88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:53.722603 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5542a4df-fd30-4ff7-b059-88fc9a901b88 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:53.737157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 606/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:55:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:53.743114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286e0a-b654-4daf-a187-efe917e4eded None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:53.831399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:53.877328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8286e0a-b654-4daf-a187-efe917e4eded None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:53.920311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b907020-7c4c-46fc-a4b7-dc70bcf95901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:53.921109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b907020-7c4c-46fc-a4b7-dc70bcf95901 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:53.921409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b907020-7c4c-46fc-a4b7-dc70bcf95901 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:53.921649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b907020-7c4c-46fc-a4b7-dc70bcf95901 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:53.932507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b907020-7c4c-46fc-a4b7-dc70bcf95901 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:53.932507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b907020-7c4c-46fc-a4b7-dc70bcf95901 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-6b907020-7c4c-46fc-a4b7-dc70bcf95901 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:55:53.944572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:53.945728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:53.946975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:55:53.946975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:55:53.946975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:55:53.946975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:55:53.946975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:55:53.946975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:55:53.946975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:55:53.946975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:55:53.950991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 611/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:55:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:55:53.951954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542a4df-fd30-4ff7-b059-88fc9a901b88 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:54.068133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5542a4df-fd30-4ff7-b059-88fc9a901b88 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:54.091479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:54.106524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61da7e16-06f9-4907-abf4-42719d833bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:54.107273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da7e16-06f9-4907-abf4-42719d833bbc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:54.107609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da7e16-06f9-4907-abf4-42719d833bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:54.108037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61da7e16-06f9-4907-abf4-42719d833bbc None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:54.108856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da7e16-06f9-4907-abf4-42719d833bbc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:54.109212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da7e16-06f9-4907-abf4-42719d833bbc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:54.111187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61da7e16-06f9-4907-abf4-42719d833bbc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:54.124940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 607/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:55:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:54.131071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b907020-7c4c-46fc-a4b7-dc70bcf95901 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:54.255821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b907020-7c4c-46fc-a4b7-dc70bcf95901 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:54.292729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:54.300301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6921f-af75-42fb-ab3c-3df30a0e3644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:54.300993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6921f-af75-42fb-ab3c-3df30a0e3644 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:54.301301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6921f-af75-42fb-ab3c-3df30a0e3644 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:54.301606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6921f-af75-42fb-ab3c-3df30a0e3644 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:54.302356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6921f-af75-42fb-ab3c-3df30a0e3644 None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=16a4ba52fe124009a570fd1408903cd3) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:54.302733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6921f-af75-42fb-ab3c-3df30a0e3644 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:54.304227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6921f-af75-42fb-ab3c-3df30a0e3644 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:54.311561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 612/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:55:54 2022] GET /identity/v3/role_assignments?user.id=16a4ba52fe124009a570fd1408903cd3&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:56.215587 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09d987-01eb-4c6a-8df5-0354041bdfd7 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:56.216143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09d987-01eb-4c6a-8df5-0354041bdfd7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:56.216143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09d987-01eb-4c6a-8df5-0354041bdfd7 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:56.217472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 608/1220] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:55:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:55:56.223209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14e8b1-35cd-4a8d-a725-df0edfae0f0b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:56.223659 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14e8b1-35cd-4a8d-a725-df0edfae0f0b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:56.223758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14e8b1-35cd-4a8d-a725-df0edfae0f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:56.243808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ef14e8b1-35cd-4a8d-a725-df0edfae0f0b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:55:56.245159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ef14e8b1-35cd-4a8d-a725-df0edfae0f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:55:56.329074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 613/1221] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:55:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:55:56.618694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09d987-01eb-4c6a-8df5-0354041bdfd7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:56.740075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09d987-01eb-4c6a-8df5-0354041bdfd7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:56.782801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828da6-0f09-4181-a3f8-ffad211034fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:56.783542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828da6-0f09-4181-a3f8-ffad211034fb None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:56.783847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828da6-0f09-4181-a3f8-ffad211034fb None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:56.784122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d828da6-0f09-4181-a3f8-ffad211034fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:56.795718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d828da6-0f09-4181-a3f8-ffad211034fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7d828da6-0f09-4181-a3f8-ffad211034fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:55:56.801664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:56.802807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:55:56.803805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 609/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:55:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:55:56.809209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14e8b1-35cd-4a8d-a725-df0edfae0f0b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:56.922593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14e8b1-35cd-4a8d-a725-df0edfae0f0b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:56.949499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:56.962506 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c601631-f824-4424-9012-fd7c580f24bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:56.963173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c601631-f824-4424-9012-fd7c580f24bb None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:56.963445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c601631-f824-4424-9012-fd7c580f24bb None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:56.963704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c601631-f824-4424-9012-fd7c580f24bb None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:56.964366 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c601631-f824-4424-9012-fd7c580f24bb None admin] RBAC: Adding query filter params (name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:56.964659 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c601631-f824-4424-9012-fd7c580f24bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:56.966044 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c601631-f824-4424-9012-fd7c580f24bb None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:56.974667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 614/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:55:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:56.980677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828da6-0f09-4181-a3f8-ffad211034fb None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:57.036081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:57.097410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d828da6-0f09-4181-a3f8-ffad211034fb None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:57.135138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86aaf8-630c-4073-8fa3-483515f8a161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:57.135857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86aaf8-630c-4073-8fa3-483515f8a161 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:57.136131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86aaf8-630c-4073-8fa3-483515f8a161 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:57.136391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86aaf8-630c-4073-8fa3-483515f8a161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:57.148436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86aaf8-630c-4073-8fa3-483515f8a161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:57.149953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb86aaf8-630c-4073-8fa3-483515f8a161 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-fb86aaf8-630c-4073-8fa3-483515f8a161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:55:57.169623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:57.170926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:55:57.172807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:55:57.172807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:55:57.172807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:55:57.172807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 610/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:55:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:55:57.177550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c601631-f824-4424-9012-fd7c580f24bb None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:57.284347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c601631-f824-4424-9012-fd7c580f24bb None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:57.321085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6205-34d5-48d0-82b6-1e145b89e516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:57.321828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6205-34d5-48d0-82b6-1e145b89e516 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:57.322156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6205-34d5-48d0-82b6-1e145b89e516 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:57.322418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6205-34d5-48d0-82b6-1e145b89e516 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:57.323148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c6205-34d5-48d0-82b6-1e145b89e516 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:57.323454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c6205-34d5-48d0-82b6-1e145b89e516 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:57.325019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449c6205-34d5-48d0-82b6-1e145b89e516 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:57.340001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 615/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:55:57.346235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86aaf8-630c-4073-8fa3-483515f8a161 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:57.446703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:57.454129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86aaf8-630c-4073-8fa3-483515f8a161 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:57.490049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb82da-3f75-4524-9510-d575d0482041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:57.490680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb82da-3f75-4524-9510-d575d0482041 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:57.490983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb82da-3f75-4524-9510-d575d0482041 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:57.491254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13bb82da-3f75-4524-9510-d575d0482041 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:57.498965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb82da-3f75-4524-9510-d575d0482041 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:57.500552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13bb82da-3f75-4524-9510-d575d0482041 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-13bb82da-3f75-4524-9510-d575d0482041 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:55:57.511584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:57.512721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:55:57.513779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 611/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:55:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:55:57.519967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6205-34d5-48d0-82b6-1e145b89e516 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:57.572444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:57.631076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6205-34d5-48d0-82b6-1e145b89e516 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:57.667701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c35ea2-70bb-46fb-b5f9-3f8e0737bc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:57.668307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c35ea2-70bb-46fb-b5f9-3f8e0737bc73 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:57.668584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c35ea2-70bb-46fb-b5f9-3f8e0737bc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:57.668872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c35ea2-70bb-46fb-b5f9-3f8e0737bc73 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:57.669603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c35ea2-70bb-46fb-b5f9-3f8e0737bc73 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:57.669900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c35ea2-70bb-46fb-b5f9-3f8e0737bc73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:57.671413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c35ea2-70bb-46fb-b5f9-3f8e0737bc73 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:57.690460 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 616/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Aug 18 20:55:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:57.696607 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb82da-3f75-4524-9510-d575d0482041 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:57.804178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13bb82da-3f75-4524-9510-d575d0482041 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:57.842371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ada3b-e248-4b23-b2a4-57086d532484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:57.843083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ada3b-e248-4b23-b2a4-57086d532484 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:57.843359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ada3b-e248-4b23-b2a4-57086d532484 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:57.843625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ada3b-e248-4b23-b2a4-57086d532484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:57.855465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ada3b-e248-4b23-b2a4-57086d532484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:57.857234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ada3b-e248-4b23-b2a4-57086d532484 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-867ada3b-e248-4b23-b2a4-57086d532484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:55:57.873986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:57.875412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:55:57.876478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:55:57.876478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:55:57.876478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:55:57.877115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 612/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:55:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:55:57.881754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c35ea2-70bb-46fb-b5f9-3f8e0737bc73 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:57.995450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c35ea2-70bb-46fb-b5f9-3f8e0737bc73 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:57.997735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:58.035108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e8d7f-e52e-43e3-9323-cc5d0b0428dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:58.035734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e8d7f-e52e-43e3-9323-cc5d0b0428dd None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:58.036102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e8d7f-e52e-43e3-9323-cc5d0b0428dd None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:58.036400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1e8d7f-e52e-43e3-9323-cc5d0b0428dd None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:58.037165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e8d7f-e52e-43e3-9323-cc5d0b0428dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:58.037498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e8d7f-e52e-43e3-9323-cc5d0b0428dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:58.039060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1e8d7f-e52e-43e3-9323-cc5d0b0428dd None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:58.052763 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 617/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:55:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:55:58.058970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ada3b-e248-4b23-b2a4-57086d532484 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:58.069202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:58.182414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ada3b-e248-4b23-b2a4-57086d532484 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:58.228230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01168f7e-6422-418a-9e46-61fe1e2f26fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:58.229075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01168f7e-6422-418a-9e46-61fe1e2f26fa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:58.229357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01168f7e-6422-418a-9e46-61fe1e2f26fa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:58.229655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01168f7e-6422-418a-9e46-61fe1e2f26fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:58.237827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01168f7e-6422-418a-9e46-61fe1e2f26fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:58.239463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01168f7e-6422-418a-9e46-61fe1e2f26fa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-01168f7e-6422-418a-9e46-61fe1e2f26fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:55:58.251445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:55:58.252568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:55:58.256029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:55:58.256029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:55:58.256029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:55:58.256029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:55:58.256029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:55:58.256029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:55:58.256029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:55:58.256029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:55:58.256029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 613/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:55:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:55:58.258731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e8d7f-e52e-43e3-9323-cc5d0b0428dd None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:58.374182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1e8d7f-e52e-43e3-9323-cc5d0b0428dd None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:58.409403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee613f38-1ba7-49fc-9688-10eb7d4860ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:58.410114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee613f38-1ba7-49fc-9688-10eb7d4860ab None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:58.410386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee613f38-1ba7-49fc-9688-10eb7d4860ab None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:58.410658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee613f38-1ba7-49fc-9688-10eb7d4860ab None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:58.411388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee613f38-1ba7-49fc-9688-10eb7d4860ab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:55:58.411686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee613f38-1ba7-49fc-9688-10eb7d4860ab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:58.413169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee613f38-1ba7-49fc-9688-10eb7d4860ab None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:58.426901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 618/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:55:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:55:58.433386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01168f7e-6422-418a-9e46-61fe1e2f26fa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:55:58.507560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:55:58.547116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01168f7e-6422-418a-9e46-61fe1e2f26fa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:55:58.582899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c795c4-22d0-4368-9ea2-ebf44a1d5b22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:55:58.583617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c795c4-22d0-4368-9ea2-ebf44a1d5b22 None admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:55:58.583938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c795c4-22d0-4368-9ea2-ebf44a1d5b22 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:55:58.584244 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c795c4-22d0-4368-9ea2-ebf44a1d5b22 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/16a4ba52fe124009a570fd1408903cd3/roles/9b6f095785d54dbe9e3c0b35fff633d2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:55:58.599851 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c795c4-22d0-4368-9ea2-ebf44a1d5b22 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=16a4ba52fe124009a570fd1408903cd3, role_id=9b6f095785d54dbe9e3c0b35fff633d2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:55:58.601367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c795c4-22d0-4368-9ea2-ebf44a1d5b22 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:55:58.615558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 614/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:55:58 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/16a4ba52fe124009a570fd1408903cd3/roles/9b6f095785d54dbe9e3c0b35fff633d2 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 20:56:00.603479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430260c-c73f-4fa1-82d8-7ac4a56f8a67 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:00.604106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430260c-c73f-4fa1-82d8-7ac4a56f8a67 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:00.604106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1430260c-c73f-4fa1-82d8-7ac4a56f8a67 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:00.605599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 619/1233] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:00.611512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd899f0-221d-4d1a-a92b-1e8c286e1088 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:00.611962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd899f0-221d-4d1a-a92b-1e8c286e1088 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:00.612073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd899f0-221d-4d1a-a92b-1e8c286e1088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:00.632093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fdd899f0-221d-4d1a-a92b-1e8c286e1088 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:00.633390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fdd899f0-221d-4d1a-a92b-1e8c286e1088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:00.704284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 615/1234] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:56:00.989599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430260c-c73f-4fa1-82d8-7ac4a56f8a67 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:01.024662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:01.111067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1430260c-c73f-4fa1-82d8-7ac4a56f8a67 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:01.148561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560a448-5c13-4f8e-b199-08224e822f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:01.149204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560a448-5c13-4f8e-b199-08224e822f33 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:01.149479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560a448-5c13-4f8e-b199-08224e822f33 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:01.149722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3560a448-5c13-4f8e-b199-08224e822f33 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:01.163461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3560a448-5c13-4f8e-b199-08224e822f33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-3560a448-5c13-4f8e-b199-08224e822f33 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:56:01.169338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:01.170593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:01.171557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 620/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Thu Aug 18 20:56:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:01.177008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd899f0-221d-4d1a-a92b-1e8c286e1088 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:01.226336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:01.286687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd899f0-221d-4d1a-a92b-1e8c286e1088 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:01.322789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fef85-c0eb-416f-94ae-0a3011a3a053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:01.323558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fef85-c0eb-416f-94ae-0a3011a3a053 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:01.323828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fef85-c0eb-416f-94ae-0a3011a3a053 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:01.324230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210fef85-c0eb-416f-94ae-0a3011a3a053 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:01.324963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fef85-c0eb-416f-94ae-0a3011a3a053 None admin] RBAC: Adding query filter params (name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:01.325270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fef85-c0eb-416f-94ae-0a3011a3a053 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:01.326657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210fef85-c0eb-416f-94ae-0a3011a3a053 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:01.335296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 616/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Thu Aug 18 20:56:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:01.341204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560a448-5c13-4f8e-b199-08224e822f33 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:01.432271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:01.450169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3560a448-5c13-4f8e-b199-08224e822f33 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:01.488893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dc7e7-546d-4994-a69f-7500a4d9e6a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:01.489568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dc7e7-546d-4994-a69f-7500a4d9e6a5 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:01.489843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dc7e7-546d-4994-a69f-7500a4d9e6a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:01.490106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02dc7e7-546d-4994-a69f-7500a4d9e6a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:01.501322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dc7e7-546d-4994-a69f-7500a4d9e6a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:01.502793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02dc7e7-546d-4994-a69f-7500a4d9e6a5 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-f02dc7e7-546d-4994-a69f-7500a4d9e6a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:01.517597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:01.524547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:01.525465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:01.525465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:01.525465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:01.525465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 621/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:01.525701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fef85-c0eb-416f-94ae-0a3011a3a053 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:01.631486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210fef85-c0eb-416f-94ae-0a3011a3a053 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:01.641551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:01.669955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023fe44-ceca-4daf-acbe-0d0b15b79c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:01.670564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023fe44-ceca-4daf-acbe-0d0b15b79c4d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:01.670972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023fe44-ceca-4daf-acbe-0d0b15b79c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:01.671208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023fe44-ceca-4daf-acbe-0d0b15b79c4d None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:01.672058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023fe44-ceca-4daf-acbe-0d0b15b79c4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:01.672535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023fe44-ceca-4daf-acbe-0d0b15b79c4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:01.673971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023fe44-ceca-4daf-acbe-0d0b15b79c4d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:01.685853 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 617/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:01.691830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dc7e7-546d-4994-a69f-7500a4d9e6a5 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:01.819178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02dc7e7-546d-4994-a69f-7500a4d9e6a5 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:01.855646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6550a31-a904-496b-b60d-1ccc5874f8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:01.856280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6550a31-a904-496b-b60d-1ccc5874f8bc None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:01.856555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6550a31-a904-496b-b60d-1ccc5874f8bc None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:01.856821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6550a31-a904-496b-b60d-1ccc5874f8bc None admin] PATH_INFO: `/v3/users/placement` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:01.860212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:01.866206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6550a31-a904-496b-b60d-1ccc5874f8bc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:01.868179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6550a31-a904-496b-b60d-1ccc5874f8bc None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-c6550a31-a904-496b-b60d-1ccc5874f8bc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:56:01.882295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:01.883464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:01.884444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 622/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:56:01.889972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023fe44-ceca-4daf-acbe-0d0b15b79c4d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:02.020170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023fe44-ceca-4daf-acbe-0d0b15b79c4d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:02.059773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279bd85-fc89-41ba-a0a3-155672fced87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:02.060346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279bd85-fc89-41ba-a0a3-155672fced87 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:02.060669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279bd85-fc89-41ba-a0a3-155672fced87 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:02.060980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a279bd85-fc89-41ba-a0a3-155672fced87 None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:02.061788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279bd85-fc89-41ba-a0a3-155672fced87 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:02.062141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279bd85-fc89-41ba-a0a3-155672fced87 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:02.064111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a279bd85-fc89-41ba-a0a3-155672fced87 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:02.083910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 618/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Aug 18 20:56:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:02.090280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6550a31-a904-496b-b60d-1ccc5874f8bc None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:02.207141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6550a31-a904-496b-b60d-1ccc5874f8bc None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:02.246738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7f91-a864-4d1a-a194-25080c59f7ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:02.247454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7f91-a864-4d1a-a194-25080c59f7ab None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:02.247735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7f91-a864-4d1a-a194-25080c59f7ab None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:02.248050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff7f91-a864-4d1a-a194-25080c59f7ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:02.326092 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:02.335561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff7f91-a864-4d1a-a194-25080c59f7ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:02.337463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff7f91-a864-4d1a-a194-25080c59f7ab None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:02.450650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 623/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:56:02 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:56:02.457402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279bd85-fc89-41ba-a0a3-155672fced87 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:02.488558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:02.577740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a279bd85-fc89-41ba-a0a3-155672fced87 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:02.629267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3f35-bdd4-4fec-bc35-3687898595aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:02.630051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3f35-bdd4-4fec-bc35-3687898595aa None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:02.630334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3f35-bdd4-4fec-bc35-3687898595aa None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:02.630607 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb3f35-bdd4-4fec-bc35-3687898595aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:02.642404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3f35-bdd4-4fec-bc35-3687898595aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:02.643942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb3f35-bdd4-4fec-bc35-3687898595aa None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-7dfb3f35-bdd4-4fec-bc35-3687898595aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:02.661914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:02.663259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:02.664359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:02.664359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:02.664359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:02.667100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 619/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:02.670009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7f91-a864-4d1a-a194-25080c59f7ab None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:02.783729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:02.790388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff7f91-a864-4d1a-a194-25080c59f7ab None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:02.829266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ab633-6e18-4f0c-8731-29642c634895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:02.829944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ab633-6e18-4f0c-8731-29642c634895 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:02.830224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ab633-6e18-4f0c-8731-29642c634895 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:02.830498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4ab633-6e18-4f0c-8731-29642c634895 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:02.831182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ab633-6e18-4f0c-8731-29642c634895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:02.831484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ab633-6e18-4f0c-8731-29642c634895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:02.832872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4ab633-6e18-4f0c-8731-29642c634895 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:02.850425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 624/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:02.851506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3f35-bdd4-4fec-bc35-3687898595aa None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:02.947747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:02.976107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb3f35-bdd4-4fec-bc35-3687898595aa None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:03.013626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c0bea-6854-493e-971a-ffc9a03d5337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:03.014264 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c0bea-6854-493e-971a-ffc9a03d5337 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:03.014539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c0bea-6854-493e-971a-ffc9a03d5337 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:03.014836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171c0bea-6854-493e-971a-ffc9a03d5337 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:03.022201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c0bea-6854-493e-971a-ffc9a03d5337 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:03.023687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171c0bea-6854-493e-971a-ffc9a03d5337 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-171c0bea-6854-493e-971a-ffc9a03d5337 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:56:03.036321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:03.037530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:03.038452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:56:03.038452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:56:03.038452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:56:03.038452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:56:03.038452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:56:03.038452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:56:03.038452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:03.038452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:03.038452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 620/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:56:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:56:03.043743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ab633-6e18-4f0c-8731-29642c634895 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:03.168455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4ab633-6e18-4f0c-8731-29642c634895 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:03.214658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35af53ee-6eaa-44d2-95e0-8b7a3bc3194c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:03.215525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af53ee-6eaa-44d2-95e0-8b7a3bc3194c None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:03.215878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af53ee-6eaa-44d2-95e0-8b7a3bc3194c None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:03.216243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35af53ee-6eaa-44d2-95e0-8b7a3bc3194c None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:03.216988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af53ee-6eaa-44d2-95e0-8b7a3bc3194c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:03.217348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af53ee-6eaa-44d2-95e0-8b7a3bc3194c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:03.219080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35af53ee-6eaa-44d2-95e0-8b7a3bc3194c None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:03.232547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 625/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:56:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:56:03.239428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c0bea-6854-493e-971a-ffc9a03d5337 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:03.354064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171c0bea-6854-493e-971a-ffc9a03d5337 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:03.392808 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae364fe-2dc3-40bd-bdde-4159b9c64fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:03.393419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae364fe-2dc3-40bd-bdde-4159b9c64fac None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:03.393694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae364fe-2dc3-40bd-bdde-4159b9c64fac None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:03.393964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae364fe-2dc3-40bd-bdde-4159b9c64fac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:03.395045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae364fe-2dc3-40bd-bdde-4159b9c64fac None admin] RBAC: Adding query filter params (role.id=9b6f095785d54dbe9e3c0b35fff633d2, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=16a4ba52fe124009a570fd1408903cd3) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:03.395369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae364fe-2dc3-40bd-bdde-4159b9c64fac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:03.396800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae364fe-2dc3-40bd-bdde-4159b9c64fac None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:03.402978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 621/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:56:03 2022] GET /identity/v3/role_assignments?user.id=16a4ba52fe124009a570fd1408903cd3&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=9b6f095785d54dbe9e3c0b35fff633d2 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:05.619199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810cd43-1e72-444b-bc79-13935d26ae81 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:05.619828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810cd43-1e72-444b-bc79-13935d26ae81 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:05.619932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c810cd43-1e72-444b-bc79-13935d26ae81 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:05.621348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 626/1247] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:56:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:05.627195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416e80-24a5-4150-b0a8-04163b4eed5e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:05.627673 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416e80-24a5-4150-b0a8-04163b4eed5e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:05.627773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1416e80-24a5-4150-b0a8-04163b4eed5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:05.635119 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:05.648781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f1416e80-24a5-4150-b0a8-04163b4eed5e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:05.650065 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f1416e80-24a5-4150-b0a8-04163b4eed5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:05.724377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 622/1248] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 18 20:56:06.012381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810cd43-1e72-444b-bc79-13935d26ae81 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:06.039488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:06.141460 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c810cd43-1e72-444b-bc79-13935d26ae81 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:06.184680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ad15c-e7a1-491f-b61a-e1cdd5c0a054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:06.185661 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ad15c-e7a1-491f-b61a-e1cdd5c0a054 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:06.186074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ad15c-e7a1-491f-b61a-e1cdd5c0a054 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:06.186503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ad15c-e7a1-491f-b61a-e1cdd5c0a054 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:06.203383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ad15c-e7a1-491f-b61a-e1cdd5c0a054 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-be1ad15c-e7a1-491f-b61a-e1cdd5c0a054 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:56:06.213104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:06.214208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:06.215245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 627/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:06.222391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416e80-24a5-4150-b0a8-04163b4eed5e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:06.335655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1416e80-24a5-4150-b0a8-04163b4eed5e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:06.370780 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:06.378285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df8aa7-9460-4489-a469-6e0acdcd7420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:06.379309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df8aa7-9460-4489-a469-6e0acdcd7420 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:06.379779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df8aa7-9460-4489-a469-6e0acdcd7420 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:06.380168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88df8aa7-9460-4489-a469-6e0acdcd7420 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:06.380885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df8aa7-9460-4489-a469-6e0acdcd7420 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:06.381216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df8aa7-9460-4489-a469-6e0acdcd7420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:06.382891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88df8aa7-9460-4489-a469-6e0acdcd7420 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:06.393533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 623/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:56:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:06.400304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ad15c-e7a1-491f-b61a-e1cdd5c0a054 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:06.488501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:06.514322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ad15c-e7a1-491f-b61a-e1cdd5c0a054 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:06.551820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b97b9-9d30-4ac0-9909-b84772193486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:06.552499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b97b9-9d30-4ac0-9909-b84772193486 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:06.552775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b97b9-9d30-4ac0-9909-b84772193486 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:06.553085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869b97b9-9d30-4ac0-9909-b84772193486 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:06.564847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b97b9-9d30-4ac0-9909-b84772193486 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:06.566317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869b97b9-9d30-4ac0-9909-b84772193486 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-869b97b9-9d30-4ac0-9909-b84772193486 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:06.584701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:06.587316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:06.588301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:06.588301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:06.588301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:06.588301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 628/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:06.595712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df8aa7-9460-4489-a469-6e0acdcd7420 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:06.721820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88df8aa7-9460-4489-a469-6e0acdcd7420 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:06.757485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dfbf2-7996-4848-809f-9dc392789f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:06.758111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dfbf2-7996-4848-809f-9dc392789f0b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:06.758390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dfbf2-7996-4848-809f-9dc392789f0b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:06.758706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40dfbf2-7996-4848-809f-9dc392789f0b None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:06.759443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dfbf2-7996-4848-809f-9dc392789f0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:06.759749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dfbf2-7996-4848-809f-9dc392789f0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:06.761241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40dfbf2-7996-4848-809f-9dc392789f0b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:06.775884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 624/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:56:06.782128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b97b9-9d30-4ac0-9909-b84772193486 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:06.900879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869b97b9-9d30-4ac0-9909-b84772193486 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:06.929542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:06.939433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532be6e-b111-40fc-9f50-a2d351713caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:06.940094 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532be6e-b111-40fc-9f50-a2d351713caf None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:06.940373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532be6e-b111-40fc-9f50-a2d351713caf None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:06.940647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0532be6e-b111-40fc-9f50-a2d351713caf None admin] PATH_INFO: `/v3/users/placement` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:06.949238 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532be6e-b111-40fc-9f50-a2d351713caf None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:06.950701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0532be6e-b111-40fc-9f50-a2d351713caf None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-0532be6e-b111-40fc-9f50-a2d351713caf None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:56:06.963249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:06.964315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:06.965335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 629/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:06.971023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dfbf2-7996-4848-809f-9dc392789f0b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:07.036329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:07.087981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40dfbf2-7996-4848-809f-9dc392789f0b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:07.123918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7d2df-c050-476a-b6bc-dc196e548d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:07.124536 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7d2df-c050-476a-b6bc-dc196e548d6c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:07.124816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7d2df-c050-476a-b6bc-dc196e548d6c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:07.125419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d7d2df-c050-476a-b6bc-dc196e548d6c None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:07.126549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7d2df-c050-476a-b6bc-dc196e548d6c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:07.126894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7d2df-c050-476a-b6bc-dc196e548d6c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:07.128361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d7d2df-c050-476a-b6bc-dc196e548d6c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:07.150273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 625/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Aug 18 20:56:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:07.157517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532be6e-b111-40fc-9f50-a2d351713caf None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:07.285622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0532be6e-b111-40fc-9f50-a2d351713caf None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:07.325661 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67cf34-28fb-4770-9b11-05d7af94c673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:07.326304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67cf34-28fb-4770-9b11-05d7af94c673 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:07.326589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67cf34-28fb-4770-9b11-05d7af94c673 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:07.326899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f67cf34-28fb-4770-9b11-05d7af94c673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:07.394481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:07.412398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67cf34-28fb-4770-9b11-05d7af94c673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:07.414874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f67cf34-28fb-4770-9b11-05d7af94c673 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:07.536236 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 630/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:56:07 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 18 20:56:07.542721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7d2df-c050-476a-b6bc-dc196e548d6c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:07.667369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d7d2df-c050-476a-b6bc-dc196e548d6c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:07.683389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:07.712816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49fc9c-f4a7-4d1d-9fe7-ae7046375005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:07.713593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49fc9c-f4a7-4d1d-9fe7-ae7046375005 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:07.714104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49fc9c-f4a7-4d1d-9fe7-ae7046375005 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:07.714655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b49fc9c-f4a7-4d1d-9fe7-ae7046375005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:07.729457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49fc9c-f4a7-4d1d-9fe7-ae7046375005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:07.731190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b49fc9c-f4a7-4d1d-9fe7-ae7046375005 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9b49fc9c-f4a7-4d1d-9fe7-ae7046375005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:07.748245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:07.749467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:07.750413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:07.750413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:07.750413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:07.750413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 626/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:07.758699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67cf34-28fb-4770-9b11-05d7af94c673 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:07.867995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:07.880997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f67cf34-28fb-4770-9b11-05d7af94c673 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:07.918468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf9195-634d-44d2-8d88-740089184d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:07.919101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf9195-634d-44d2-8d88-740089184d19 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:07.919375 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf9195-634d-44d2-8d88-740089184d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:07.919638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf9195-634d-44d2-8d88-740089184d19 None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:07.920281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf9195-634d-44d2-8d88-740089184d19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:07.920581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf9195-634d-44d2-8d88-740089184d19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:07.922224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cf9195-634d-44d2-8d88-740089184d19 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:07.934830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 631/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:07.940248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49fc9c-f4a7-4d1d-9fe7-ae7046375005 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:08.046521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b49fc9c-f4a7-4d1d-9fe7-ae7046375005 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:08.084334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace49c5-3aef-4c28-8340-c3205246484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:08.084973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace49c5-3aef-4c28-8340-c3205246484c None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:08.085250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace49c5-3aef-4c28-8340-c3205246484c None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:08.085518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ace49c5-3aef-4c28-8340-c3205246484c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:08.092898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace49c5-3aef-4c28-8340-c3205246484c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:08.094474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ace49c5-3aef-4c28-8340-c3205246484c None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-9ace49c5-3aef-4c28-8340-c3205246484c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:56:08.106196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:08.107230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:08.108486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:56:08.108486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:56:08.108486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:56:08.108486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:56:08.108486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:56:08.108486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:56:08.108486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:08.108486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:08.110848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 627/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:56:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:08.113953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf9195-634d-44d2-8d88-740089184d19 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:08.244125 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf9195-634d-44d2-8d88-740089184d19 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:08.280932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a0a9c-dc15-43c1-bb9d-be2df583ebe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:08.282147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a0a9c-dc15-43c1-bb9d-be2df583ebe3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:08.282429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a0a9c-dc15-43c1-bb9d-be2df583ebe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:08.282700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a0a9c-dc15-43c1-bb9d-be2df583ebe3 None admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:08.283424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a0a9c-dc15-43c1-bb9d-be2df583ebe3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:08.283725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a0a9c-dc15-43c1-bb9d-be2df583ebe3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:08.285165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a0a9c-dc15-43c1-bb9d-be2df583ebe3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:08.301052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 632/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:56:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:56:08.307550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace49c5-3aef-4c28-8340-c3205246484c None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:08.337096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:08.433441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ace49c5-3aef-4c28-8340-c3205246484c None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:08.473200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9b820a-7def-45d4-b497-630b40382fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:08.473842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b820a-7def-45d4-b497-630b40382fcc None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:08.474146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b820a-7def-45d4-b497-630b40382fcc None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:08.474373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9b820a-7def-45d4-b497-630b40382fcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:08.475231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b820a-7def-45d4-b497-630b40382fcc None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=16a4ba52fe124009a570fd1408903cd3) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:08.475540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b820a-7def-45d4-b497-630b40382fcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:08.477074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9b820a-7def-45d4-b497-630b40382fcc None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:08.483024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 628/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:56:08 2022] GET /identity/v3/role_assignments?user.id=16a4ba52fe124009a570fd1408903cd3&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=85a146946817410b9a3addcf041c5909 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:10.464983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14a42-1a15-48bf-b5db-fb154629cc79 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:10.465562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14a42-1a15-48bf-b5db-fb154629cc79 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:10.465562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a14a42-1a15-48bf-b5db-fb154629cc79 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:10.466983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 633/1261] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:56:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:10.472549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dd80a-629e-42fb-b074-cbe200c37c8d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:10.473002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dd80a-629e-42fb-b074-cbe200c37c8d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:10.473100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862dd80a-629e-42fb-b074-cbe200c37c8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:10.493426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-862dd80a-629e-42fb-b074-cbe200c37c8d None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:10.494640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-862dd80a-629e-42fb-b074-cbe200c37c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:10.568791 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 629/1262] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:10.836670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a14a42-1a15-48bf-b5db-fb154629cc79 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:10.855006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:10.956470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a14a42-1a15-48bf-b5db-fb154629cc79 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:10.991857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7c7dc-9812-4b20-8095-472a883c2cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:10.992477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7c7dc-9812-4b20-8095-472a883c2cfc None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:10.992750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7c7dc-9812-4b20-8095-472a883c2cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:10.993017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7c7dc-9812-4b20-8095-472a883c2cfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:11.003855 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7c7dc-9812-4b20-8095-472a883c2cfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-d6f7c7dc-9812-4b20-8095-472a883c2cfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:56:11.008499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:11.009576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:11.010646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:11.014613 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 634/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:11.015879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dd80a-629e-42fb-b074-cbe200c37c8d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:11.037229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:11.136711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862dd80a-629e-42fb-b074-cbe200c37c8d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:11.176445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d49dd-c7be-43d0-95f9-bd8fe17071e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:11.177193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d49dd-c7be-43d0-95f9-bd8fe17071e7 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:11.177472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d49dd-c7be-43d0-95f9-bd8fe17071e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:11.177786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9d49dd-c7be-43d0-95f9-bd8fe17071e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:11.178469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d49dd-c7be-43d0-95f9-bd8fe17071e7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:11.178892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d49dd-c7be-43d0-95f9-bd8fe17071e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:11.180423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9d49dd-c7be-43d0-95f9-bd8fe17071e7 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:11.190292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 630/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:56:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:56:11.197537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7c7dc-9812-4b20-8095-472a883c2cfc None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:11.273628 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:11.307139 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7c7dc-9812-4b20-8095-472a883c2cfc None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:11.343605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6d060-d6b7-44db-9148-663646d8d0b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:11.344348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6d060-d6b7-44db-9148-663646d8d0b3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:11.344608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6d060-d6b7-44db-9148-663646d8d0b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:11.344912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df6d060-d6b7-44db-9148-663646d8d0b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:11.355928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6d060-d6b7-44db-9148-663646d8d0b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:11.358009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df6d060-d6b7-44db-9148-663646d8d0b3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-0df6d060-d6b7-44db-9148-663646d8d0b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:11.377246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:11.378351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:11.379711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:11.379711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:11.379711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:11.379711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 635/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:11.387929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d49dd-c7be-43d0-95f9-bd8fe17071e7 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:11.473002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:11.493693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9d49dd-c7be-43d0-95f9-bd8fe17071e7 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:11.535237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe72cb-ab4f-4509-b482-42e8e12e0994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:11.535833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe72cb-ab4f-4509-b482-42e8e12e0994 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:11.536109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe72cb-ab4f-4509-b482-42e8e12e0994 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:11.536377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbe72cb-ab4f-4509-b482-42e8e12e0994 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:11.537022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe72cb-ab4f-4509-b482-42e8e12e0994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:11.537325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe72cb-ab4f-4509-b482-42e8e12e0994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:11.538696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbe72cb-ab4f-4509-b482-42e8e12e0994 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:11.550718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 631/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:11.557371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6d060-d6b7-44db-9148-663646d8d0b3 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:11.668737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df6d060-d6b7-44db-9148-663646d8d0b3 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:11.688883 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:11.705813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac608f-5d38-44e4-aea4-78bbbf7e8907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:11.706436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac608f-5d38-44e4-aea4-78bbbf7e8907 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:11.706709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac608f-5d38-44e4-aea4-78bbbf7e8907 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:11.707010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eac608f-5d38-44e4-aea4-78bbbf7e8907 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:11.714653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac608f-5d38-44e4-aea4-78bbbf7e8907 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:11.716127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eac608f-5d38-44e4-aea4-78bbbf7e8907 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-6eac608f-5d38-44e4-aea4-78bbbf7e8907 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:56:11.728245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:11.729435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:11.730751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 636/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:11.735589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe72cb-ab4f-4509-b482-42e8e12e0994 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:11.854970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbe72cb-ab4f-4509-b482-42e8e12e0994 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:11.892584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35724080-deae-42b1-a625-fe7021628e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:11.893172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35724080-deae-42b1-a625-fe7021628e2f None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:11.893442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35724080-deae-42b1-a625-fe7021628e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:11.893709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35724080-deae-42b1-a625-fe7021628e2f None admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:11.894800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35724080-deae-42b1-a625-fe7021628e2f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:11.895100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35724080-deae-42b1-a625-fe7021628e2f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:11.896542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35724080-deae-42b1-a625-fe7021628e2f None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:11.906375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:11.915553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 632/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Aug 18 20:56:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:11.921434 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac608f-5d38-44e4-aea4-78bbbf7e8907 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:12.030924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eac608f-5d38-44e4-aea4-78bbbf7e8907 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:12.066255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039f187-a98c-4b7e-8987-93958d23bd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:12.066895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f187-a98c-4b7e-8987-93958d23bd97 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:12.067177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f187-a98c-4b7e-8987-93958d23bd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:12.067443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039f187-a98c-4b7e-8987-93958d23bd97 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:12.078423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039f187-a98c-4b7e-8987-93958d23bd97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:12.079941 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039f187-a98c-4b7e-8987-93958d23bd97 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-0039f187-a98c-4b7e-8987-93958d23bd97 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:12.095192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:12.096287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:12.097245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:12.097245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:12.097245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:12.097245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 637/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:12.102593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35724080-deae-42b1-a625-fe7021628e2f None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:12.210376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35724080-deae-42b1-a625-fe7021628e2f None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:12.249470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c88d14-a879-4a4e-a233-0b0228e02972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:12.250154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88d14-a879-4a4e-a233-0b0228e02972 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:12.250532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88d14-a879-4a4e-a233-0b0228e02972 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:12.250675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c88d14-a879-4a4e-a233-0b0228e02972 None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:12.251355 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c88d14-a879-4a4e-a233-0b0228e02972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:12.251655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c88d14-a879-4a4e-a233-0b0228e02972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:12.253026 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c88d14-a879-4a4e-a233-0b0228e02972 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:12.264388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 633/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:12.270906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039f187-a98c-4b7e-8987-93958d23bd97 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:12.303985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:12.378725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039f187-a98c-4b7e-8987-93958d23bd97 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:12.418681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2db077-88fa-4180-a4fe-9d9209758abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:12.419341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2db077-88fa-4180-a4fe-9d9209758abb None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:12.419617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2db077-88fa-4180-a4fe-9d9209758abb None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:12.419913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2db077-88fa-4180-a4fe-9d9209758abb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:12.427160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2db077-88fa-4180-a4fe-9d9209758abb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:12.428608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2db077-88fa-4180-a4fe-9d9209758abb None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-3c2db077-88fa-4180-a4fe-9d9209758abb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:56:12.439804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:12.440844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:12.441944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:56:12.441944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:56:12.441944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:56:12.441944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:56:12.441944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:56:12.441944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:56:12.441944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:12.441944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:12.441944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 638/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:56:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:12.447207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c88d14-a879-4a4e-a233-0b0228e02972 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:12.508212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:12.554810 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c88d14-a879-4a4e-a233-0b0228e02972 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:12.599333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8f3764-0a42-4e1d-8459-fd6b2d3938e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:12.599935 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f3764-0a42-4e1d-8459-fd6b2d3938e3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:12.600213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f3764-0a42-4e1d-8459-fd6b2d3938e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:12.600486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8f3764-0a42-4e1d-8459-fd6b2d3938e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:12.601177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f3764-0a42-4e1d-8459-fd6b2d3938e3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:12.601483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f3764-0a42-4e1d-8459-fd6b2d3938e3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:12.602958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8f3764-0a42-4e1d-8459-fd6b2d3938e3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:12.615525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 634/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:56:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 20:56:12.625102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2db077-88fa-4180-a4fe-9d9209758abb None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:12.726930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:12.736848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2db077-88fa-4180-a4fe-9d9209758abb None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:12.772485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41610dbc-482c-4e9f-bb6d-cf25904dbc21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:12.773086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610dbc-482c-4e9f-bb6d-cf25904dbc21 None admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:12.773362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610dbc-482c-4e9f-bb6d-cf25904dbc21 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:12.773617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41610dbc-482c-4e9f-bb6d-cf25904dbc21 None admin] PATH_INFO: `/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/16a4ba52fe124009a570fd1408903cd3/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:12.775706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41610dbc-482c-4e9f-bb6d-cf25904dbc21 None admin] RBAC: Authorizing `identity:create_grant(project_id=7702a90e64d84abd801b7c3fdf694d1d, user_id=16a4ba52fe124009a570fd1408903cd3, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:12.777147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41610dbc-482c-4e9f-bb6d-cf25904dbc21 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:12.792118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 639/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Thu Aug 18 20:56:12 2022] PUT /identity/v3/projects/7702a90e64d84abd801b7c3fdf694d1d/users/16a4ba52fe124009a570fd1408903cd3/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 20:56:14.719394 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc41f6-fd07-485b-baf7-80e355cd59b5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:14.720561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc41f6-fd07-485b-baf7-80e355cd59b5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:14.720561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdc41f6-fd07-485b-baf7-80e355cd59b5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:14.722354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 635/1274] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:56:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:14.731041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5715cc-e8a8-49bd-ab00-3ce19db044a9 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:14.731479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5715cc-e8a8-49bd-ab00-3ce19db044a9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:14.732228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5715cc-e8a8-49bd-ab00-3ce19db044a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:14.753789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-9f5715cc-e8a8-49bd-ab00-3ce19db044a9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:14.755063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-9f5715cc-e8a8-49bd-ab00-3ce19db044a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:14.829144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 640/1275] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:15.096339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc41f6-fd07-485b-baf7-80e355cd59b5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:15.228485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecdc41f6-fd07-485b-baf7-80e355cd59b5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:15.247586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:15.275163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a486dbd-d599-4bcc-a346-1826d28a2188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:15.275804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a486dbd-d599-4bcc-a346-1826d28a2188 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:15.276081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a486dbd-d599-4bcc-a346-1826d28a2188 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:15.276378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a486dbd-d599-4bcc-a346-1826d28a2188 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:15.287507 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a486dbd-d599-4bcc-a346-1826d28a2188 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-5a486dbd-d599-4bcc-a346-1826d28a2188 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 18 20:56:15.292248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:15.293382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:15.294265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 636/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Thu Aug 18 20:56:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:15.299931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5715cc-e8a8-49bd-ab00-3ce19db044a9 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:15.401220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:15.428689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5715cc-e8a8-49bd-ab00-3ce19db044a9 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:15.462429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60843f-b533-4bb4-978c-a6ff9ffeed25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:15.463105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60843f-b533-4bb4-978c-a6ff9ffeed25 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:15.463380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60843f-b533-4bb4-978c-a6ff9ffeed25 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:15.463648 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c60843f-b533-4bb4-978c-a6ff9ffeed25 None admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:15.464307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60843f-b533-4bb4-978c-a6ff9ffeed25 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:15.464608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60843f-b533-4bb4-978c-a6ff9ffeed25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:15.466009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c60843f-b533-4bb4-978c-a6ff9ffeed25 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:15.474608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 641/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Thu Aug 18 20:56:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:15.481192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a486dbd-d599-4bcc-a346-1826d28a2188 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:15.595404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a486dbd-d599-4bcc-a346-1826d28a2188 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:15.645898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bcdc4-49f7-474d-b36b-cc88d0a0936b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:15.646699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bcdc4-49f7-474d-b36b-cc88d0a0936b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:15.647005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bcdc4-49f7-474d-b36b-cc88d0a0936b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:15.647268 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bcdc4-49f7-474d-b36b-cc88d0a0936b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:15.661308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bcdc4-49f7-474d-b36b-cc88d0a0936b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:15.662684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bcdc4-49f7-474d-b36b-cc88d0a0936b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-629bcdc4-49f7-474d-b36b-cc88d0a0936b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:15.677805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:15.678884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:15.680656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:15.680656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:15.680656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:15.680656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 637/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:15.688485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60843f-b533-4bb4-978c-a6ff9ffeed25 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:15.810563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c60843f-b533-4bb4-978c-a6ff9ffeed25 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:15.847474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1706fd-552f-45ab-bec2-da1e420975cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:15.848358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1706fd-552f-45ab-bec2-da1e420975cc None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:15.848825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1706fd-552f-45ab-bec2-da1e420975cc None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:15.849239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1706fd-552f-45ab-bec2-da1e420975cc None admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:15.850259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1706fd-552f-45ab-bec2-da1e420975cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:15.850735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1706fd-552f-45ab-bec2-da1e420975cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:15.853068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1706fd-552f-45ab-bec2-da1e420975cc None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:15.871819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 642/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:15.879683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bcdc4-49f7-474d-b36b-cc88d0a0936b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:15.915861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:15.996889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bcdc4-49f7-474d-b36b-cc88d0a0936b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:16.031608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc148-17af-4069-8aba-3208c107c1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:16.032226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc148-17af-4069-8aba-3208c107c1ba None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:16.032493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc148-17af-4069-8aba-3208c107c1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:16.032758 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4fc148-17af-4069-8aba-3208c107c1ba None admin] PATH_INFO: `/v3/users/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:16.040476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fc148-17af-4069-8aba-3208c107c1ba None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:16.041927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4fc148-17af-4069-8aba-3208c107c1ba None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-3f4fc148-17af-4069-8aba-3208c107c1ba None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 18 20:56:16.053266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:16.054419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:16.055647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 638/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:16.060913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1706fd-552f-45ab-bec2-da1e420975cc None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:16.067235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:16.181171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1706fd-552f-45ab-bec2-da1e420975cc None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:16.219035 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c4fd1-d090-4d36-ad75-d3faf90b9d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:16.219694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4fd1-d090-4d36-ad75-d3faf90b9d18 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:16.219971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4fd1-d090-4d36-ad75-d3faf90b9d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:16.220243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9c4fd1-d090-4d36-ad75-d3faf90b9d18 None admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:16.220974 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c4fd1-d090-4d36-ad75-d3faf90b9d18 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:16.221278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c4fd1-d090-4d36-ad75-d3faf90b9d18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:16.222743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9c4fd1-d090-4d36-ad75-d3faf90b9d18 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:16.241228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 643/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Thu Aug 18 20:56:16 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:16.247263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc148-17af-4069-8aba-3208c107c1ba None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:16.364234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:16.374678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4fc148-17af-4069-8aba-3208c107c1ba None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:16.410205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007e4fd-6f0d-4aa6-ac3a-edada30820d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:16.410887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007e4fd-6f0d-4aa6-ac3a-edada30820d3 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:16.411167 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007e4fd-6f0d-4aa6-ac3a-edada30820d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:16.411599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8007e4fd-6f0d-4aa6-ac3a-edada30820d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:16.482972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007e4fd-6f0d-4aa6-ac3a-edada30820d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:16.484436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8007e4fd-6f0d-4aa6-ac3a-edada30820d3 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:16.586254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:16.598858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 639/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Thu Aug 18 20:56:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 18 20:56:16.605536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c4fd1-d090-4d36-ad75-d3faf90b9d18 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:16.677952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:16.721222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9c4fd1-d090-4d36-ad75-d3faf90b9d18 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:16.756441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506d82-857b-4535-adb7-ff66e61920ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:16.757005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506d82-857b-4535-adb7-ff66e61920ad None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:16.757281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506d82-857b-4535-adb7-ff66e61920ad None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:16.757546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed506d82-857b-4535-adb7-ff66e61920ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:16.768729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506d82-857b-4535-adb7-ff66e61920ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:16.770546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed506d82-857b-4535-adb7-ff66e61920ad None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-ed506d82-857b-4535-adb7-ff66e61920ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 18 20:56:16.786682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:16.787894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 18 20:56:16.788989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 18 20:56:16.788989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 18 20:56:16.788989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:16.788989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 644/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 20:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 18 20:56:16.793926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007e4fd-6f0d-4aa6-ac3a-edada30820d3 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:16.913213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8007e4fd-6f0d-4aa6-ac3a-edada30820d3 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:16.948816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b3c99-fc2c-4d7b-ba15-a5fe6439fdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:16.949406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3c99-fc2c-4d7b-ba15-a5fe6439fdcd None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:16.949674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3c99-fc2c-4d7b-ba15-a5fe6439fdcd None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:16.949937 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007b3c99-fc2c-4d7b-ba15-a5fe6439fdcd None admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:16.950567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b3c99-fc2c-4d7b-ba15-a5fe6439fdcd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:16.950893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b3c99-fc2c-4d7b-ba15-a5fe6439fdcd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:16.952353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007b3c99-fc2c-4d7b-ba15-a5fe6439fdcd None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:16.964747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 640/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Thu Aug 18 20:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:16.971467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506d82-857b-4535-adb7-ff66e61920ad None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:17.093665 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed506d82-857b-4535-adb7-ff66e61920ad None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:17.107041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:17.128038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71712a6-6ce5-48be-8953-7222aa7908f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:17.128665 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71712a6-6ce5-48be-8953-7222aa7908f0 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:17.128939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71712a6-6ce5-48be-8953-7222aa7908f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:17.129208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71712a6-6ce5-48be-8953-7222aa7908f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:17.135885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71712a6-6ce5-48be-8953-7222aa7908f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:17.137340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71712a6-6ce5-48be-8953-7222aa7908f0 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application [None req-d71712a6-6ce5-48be-8953-7222aa7908f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 18 20:56:17.148810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:17.149815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:17.151127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 18 20:56:17.151127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 18 20:56:17.151127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 18 20:56:17.151127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 18 20:56:17.151127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 18 20:56:17.151127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 18 20:56:17.151127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 18 20:56:17.151127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: ERROR keystone.server.flask.application Aug 18 20:56:17.151127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 645/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Thu Aug 18 20:56:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:17.156156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b3c99-fc2c-4d7b-ba15-a5fe6439fdcd None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:17.208562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:17.263037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007b3c99-fc2c-4d7b-ba15-a5fe6439fdcd None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:17.305680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f515dfe4-2e1f-42bc-ac69-1e3af081e487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:17.306300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515dfe4-2e1f-42bc-ac69-1e3af081e487 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:17.306573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515dfe4-2e1f-42bc-ac69-1e3af081e487 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:17.306876 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f515dfe4-2e1f-42bc-ac69-1e3af081e487 None admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:17.307570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515dfe4-2e1f-42bc-ac69-1e3af081e487 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:17.307875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515dfe4-2e1f-42bc-ac69-1e3af081e487 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:17.309444 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f515dfe4-2e1f-42bc-ac69-1e3af081e487 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:17.321295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 641/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Thu Aug 18 20:56:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:17.331201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71712a6-6ce5-48be-8953-7222aa7908f0 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:17.436443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71712a6-6ce5-48be-8953-7222aa7908f0 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:17.475200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670b8ac-70e2-4240-8fce-8460e48e61cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:17.475796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670b8ac-70e2-4240-8fce-8460e48e61cf None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:17.476067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670b8ac-70e2-4240-8fce-8460e48e61cf None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:17.476342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670b8ac-70e2-4240-8fce-8460e48e61cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:17.477057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670b8ac-70e2-4240-8fce-8460e48e61cf None admin] RBAC: Adding query filter params (role.id=85a146946817410b9a3addcf041c5909, scope.project.id=7702a90e64d84abd801b7c3fdf694d1d, user.id=16a4ba52fe124009a570fd1408903cd3) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:17.477358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670b8ac-70e2-4240-8fce-8460e48e61cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:17.478809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5670b8ac-70e2-4240-8fce-8460e48e61cf None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:17.484768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 646/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Thu Aug 18 20:56:17 2022] GET /identity/v3/role_assignments?user.id=16a4ba52fe124009a570fd1408903cd3&scope.project.id=7702a90e64d84abd801b7c3fdf694d1d&role.id=85a146946817410b9a3addcf041c5909 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:19.471308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecba95-2ef3-41e7-9a98-64a65f6af8a8 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:19.471896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecba95-2ef3-41e7-9a98-64a65f6af8a8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:19.471896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecba95-2ef3-41e7-9a98-64a65f6af8a8 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:19.473247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 642/1288] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:19.479835 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561828-2a18-4413-9fc0-034046fc2865 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:19.480525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561828-2a18-4413-9fc0-034046fc2865 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:19.480716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79561828-2a18-4413-9fc0-034046fc2865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:19.506946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-79561828-2a18-4413-9fc0-034046fc2865 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:19.508130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-79561828-2a18-4413-9fc0-034046fc2865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:19.540565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:19.578631 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 647/1289] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:19.846160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecba95-2ef3-41e7-9a98-64a65f6af8a8 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:19.961850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecba95-2ef3-41e7-9a98-64a65f6af8a8 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:19.973114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:20.000612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a18c-085a-403e-8257-c369c18ce55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:20.001228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a18c-085a-403e-8257-c369c18ce55d None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:20.001496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a18c-085a-403e-8257-c369c18ce55d None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:20.001758 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d5a18c-085a-403e-8257-c369c18ce55d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:20.002334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5a18c-085a-403e-8257-c369c18ce55d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:20.003750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d5a18c-085a-403e-8257-c369c18ce55d None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-d6d5a18c-085a-403e-8257-c369c18ce55d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:20.013419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:20.014671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:20.015592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 643/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Aug 18 20:56:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:20.023643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79561828-2a18-4413-9fc0-034046fc2865 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:20.141743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79561828-2a18-4413-9fc0-034046fc2865 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:20.189310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e66dde1-56d0-44cd-9b47-eb6380c53992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:20.189938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66dde1-56d0-44cd-9b47-eb6380c53992 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:20.190243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66dde1-56d0-44cd-9b47-eb6380c53992 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:20.190589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e66dde1-56d0-44cd-9b47-eb6380c53992 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:20.191257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66dde1-56d0-44cd-9b47-eb6380c53992 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:20.191562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66dde1-56d0-44cd-9b47-eb6380c53992 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:20.193151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e66dde1-56d0-44cd-9b47-eb6380c53992 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:20.198742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 648/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Aug 18 20:56:20 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:20.205388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a18c-085a-403e-8257-c369c18ce55d None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:20.321327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d5a18c-085a-403e-8257-c369c18ce55d None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:20.358098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7654ee-ce22-4444-8884-b8dcce0486b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:20.358696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7654ee-ce22-4444-8884-b8dcce0486b5 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:20.358999 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7654ee-ce22-4444-8884-b8dcce0486b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:20.359271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7654ee-ce22-4444-8884-b8dcce0486b5 None admin] PATH_INFO: `/v3/services` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:20.359906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7654ee-ce22-4444-8884-b8dcce0486b5 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:20.360226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7654ee-ce22-4444-8884-b8dcce0486b5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:20.361604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7654ee-ce22-4444-8884-b8dcce0486b5 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:20.366798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 644/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Aug 18 20:56:20 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:22.228110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a6fc4-e1cc-4760-bf63-80219f1ed3b1 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:22.228681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a6fc4-e1cc-4760-bf63-80219f1ed3b1 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:22.228681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a6fc4-e1cc-4760-bf63-80219f1ed3b1 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:22.230016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 649/1293] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:56:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:22.236566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa92a1-3352-4573-b813-6fdc991839de None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:22.237315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa92a1-3352-4573-b813-6fdc991839de None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:22.237465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2aa92a1-3352-4573-b813-6fdc991839de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:22.267582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e2aa92a1-3352-4573-b813-6fdc991839de None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:22.268776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e2aa92a1-3352-4573-b813-6fdc991839de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:22.304346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:22.345195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 645/1294] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:22.608484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a6fc4-e1cc-4760-bf63-80219f1ed3b1 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:22.646264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:22.721861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a6fc4-e1cc-4760-bf63-80219f1ed3b1 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:22.760643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8fa10-b725-4980-977b-57db9fdb125d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:22.761261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8fa10-b725-4980-977b-57db9fdb125d None admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:22.761536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8fa10-b725-4980-977b-57db9fdb125d None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:22.761805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8fa10-b725-4980-977b-57db9fdb125d None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:22.762465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8fa10-b725-4980-977b-57db9fdb125d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:22.763879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8fa10-b725-4980-977b-57db9fdb125d None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:22.783490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 650/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Thu Aug 18 20:56:22 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:56:24.680298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6929c52-da57-4961-bdec-40462e345557 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:24.681461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6929c52-da57-4961-bdec-40462e345557 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:24.681461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6929c52-da57-4961-bdec-40462e345557 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:24.683339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 646/1296] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:56:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:24.689520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4ba55-a609-4e76-bf6c-ebb186b18413 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:24.689968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4ba55-a609-4e76-bf6c-ebb186b18413 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:24.690068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f4ba55-a609-4e76-bf6c-ebb186b18413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:24.719179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-02f4ba55-a609-4e76-bf6c-ebb186b18413 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:24.720363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-02f4ba55-a609-4e76-bf6c-ebb186b18413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:24.801351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 651/1297] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:25.067862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6929c52-da57-4961-bdec-40462e345557 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.185434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6929c52-da57-4961-bdec-40462e345557 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.223143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ae86-61b4-4e19-8e9b-2763239d965b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.224068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ae86-61b4-4e19-8e9b-2763239d965b None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.224374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ae86-61b4-4e19-8e9b-2763239d965b None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.224718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b1ae86-61b4-4e19-8e9b-2763239d965b None admin] PATH_INFO: `/v3/services/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.225333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1ae86-61b4-4e19-8e9b-2763239d965b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.227138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b1ae86-61b4-4e19-8e9b-2763239d965b None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-a8b1ae86-61b4-4e19-8e9b-2763239d965b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:25.237545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:25.238689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:25.240434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 647/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:25.248877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4ba55-a609-4e76-bf6c-ebb186b18413 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.281092 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:25.366479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f4ba55-a609-4e76-bf6c-ebb186b18413 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.402569 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb1999-7fcf-4311-a2f7-5f678d2e5b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.403220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb1999-7fcf-4311-a2f7-5f678d2e5b17 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.403495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb1999-7fcf-4311-a2f7-5f678d2e5b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.403764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb1999-7fcf-4311-a2f7-5f678d2e5b17 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.404392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb1999-7fcf-4311-a2f7-5f678d2e5b17 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:25.404693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb1999-7fcf-4311-a2f7-5f678d2e5b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.406071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb1999-7fcf-4311-a2f7-5f678d2e5b17 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.411434 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 652/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:25.418411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ae86-61b4-4e19-8e9b-2763239d965b None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.461968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:25.536144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b1ae86-61b4-4e19-8e9b-2763239d965b None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.573045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325e9b02-e667-4e77-9105-23414e064846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.573642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e9b02-e667-4e77-9105-23414e064846 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.573915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e9b02-e667-4e77-9105-23414e064846 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.574185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325e9b02-e667-4e77-9105-23414e064846 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.574915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e9b02-e667-4e77-9105-23414e064846 None admin] RBAC: Adding query filter params (interface=public, service_id=ca654d93e5fa4d19a0c0f13802a875e8, region_id=RegionOne) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:25.575221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e9b02-e667-4e77-9105-23414e064846 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.576645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325e9b02-e667-4e77-9105-23414e064846 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.581923 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 648/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/endpoints?service_id=ca654d93e5fa4d19a0c0f13802a875e8&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:25.588230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb1999-7fcf-4311-a2f7-5f678d2e5b17 None admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:25.677063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:25.696685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb1999-7fcf-4311-a2f7-5f678d2e5b17 None admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:25.731686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c507e492-6bd3-45de-8398-4fc32eb55ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:25.732280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507e492-6bd3-45de-8398-4fc32eb55ef3 None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:25.732557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507e492-6bd3-45de-8398-4fc32eb55ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:25.732825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c507e492-6bd3-45de-8398-4fc32eb55ef3 None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:25.733428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507e492-6bd3-45de-8398-4fc32eb55ef3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:25.734976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c507e492-6bd3-45de-8398-4fc32eb55ef3 None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:25.741705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 653/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Thu Aug 18 20:56:25 2022] GET /identity/v3/services => generated 2191 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 20:56:27.626457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b84b9e-e77c-4fc5-b9c3-c576f53158b1 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:27.627045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b84b9e-e77c-4fc5-b9c3-c576f53158b1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:27.627045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b84b9e-e77c-4fc5-b9c3-c576f53158b1 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:27.628396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 649/1302] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:56:27.634629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd1e34-a857-45c0-a320-f4827720880d None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:27.635431 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd1e34-a857-45c0-a320-f4827720880d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:27.635580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fd1e34-a857-45c0-a320-f4827720880d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:27.662801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-04fd1e34-a857-45c0-a320-f4827720880d None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:56:27.664007 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-04fd1e34-a857-45c0-a320-f4827720880d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:56:27.732996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 654/1303] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:56:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 18 20:56:27.994531 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b84b9e-e77c-4fc5-b9c3-c576f53158b1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:28.108862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:28.117090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b84b9e-e77c-4fc5-b9c3-c576f53158b1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:28.154563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194436a-82eb-4dd7-8bfd-3e5d1c74ea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:28.155251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194436a-82eb-4dd7-8bfd-3e5d1c74ea36 None admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:28.155526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194436a-82eb-4dd7-8bfd-3e5d1c74ea36 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:28.155800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4194436a-82eb-4dd7-8bfd-3e5d1c74ea36 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:28.156407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194436a-82eb-4dd7-8bfd-3e5d1c74ea36 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:28.157885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4194436a-82eb-4dd7-8bfd-3e5d1c74ea36 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application [None req-4194436a-82eb-4dd7-8bfd-3e5d1c74ea36 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 18 20:56:28.167124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 18 20:56:28.168128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.get_or_create( Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application with Lock( Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self._enter() Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application return self.creator() Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application created_value = creator( Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: ERROR keystone.server.flask.application Aug 18 20:56:28.168976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 650/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Thu Aug 18 20:56:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 18 20:56:28.176191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd1e34-a857-45c0-a320-f4827720880d None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:28.267172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:28.302657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fd1e34-a857-45c0-a320-f4827720880d None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:28.340405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d17ceb-0a76-425a-b438-4d4366da168a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:28.341026 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17ceb-0a76-425a-b438-4d4366da168a None admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:28.341310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17ceb-0a76-425a-b438-4d4366da168a None admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:28.341581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d17ceb-0a76-425a-b438-4d4366da168a None admin] PATH_INFO: `/v3/services` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:28.342214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d17ceb-0a76-425a-b438-4d4366da168a None admin] RBAC: Adding query filter params (name=placement) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 20:56:28.342520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d17ceb-0a76-425a-b438-4d4366da168a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:28.344064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d17ceb-0a76-425a-b438-4d4366da168a None admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:28.349644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 655/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Thu Aug 18 20:56:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 20:56:28.360132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194436a-82eb-4dd7-8bfd-3e5d1c74ea36 None admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:56:28.472164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4194436a-82eb-4dd7-8bfd-3e5d1c74ea36 None admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:56:28.513362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b79aa-5387-44d4-b4ad-1d8d75fef6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:56:28.514253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b79aa-5387-44d4-b4ad-1d8d75fef6f0 None admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:56:28.514679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b79aa-5387-44d4-b4ad-1d8d75fef6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:56:28.515136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b79aa-5387-44d4-b4ad-1d8d75fef6f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:56:28.516209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b79aa-5387-44d4-b4ad-1d8d75fef6f0 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:56:28.518350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b79aa-5387-44d4-b4ad-1d8d75fef6f0 None admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:56:28.548256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 651/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 20:56:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 20:56:38.347646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=30 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:56:38.541324 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:33.525299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0324c-f5c3-49e1-bcd4-06d7e622b1c9 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:33.525742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0324c-f5c3-49e1-bcd4-06d7e622b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:33.526042 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e0324c-f5c3-49e1-bcd4-06d7e622b1c9 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:33.527585 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 656/1307] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:57:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:33.537585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3fd09-ea10-427d-9da6-2562b745f324 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:33.538022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3fd09-ea10-427d-9da6-2562b745f324 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:33.538317 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c3fd09-ea10-427d-9da6-2562b745f324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:33.620502 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-68c3fd09-ea10-427d-9da6-2562b745f324 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:33.621853 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-68c3fd09-ea10-427d-9da6-2562b745f324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:33.809667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 652/1308] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:57:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:34.110400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de61ee-04fc-4526-9397-2ad0b1c21e7a None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:34.110854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de61ee-04fc-4526-9397-2ad0b1c21e7a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:34.111195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de61ee-04fc-4526-9397-2ad0b1c21e7a None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:34.113070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 657/1309] 10.222.0.59 () {54 vars in 965 bytes} [Thu Aug 18 20:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:34.120165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a05d9-20f7-46f6-a22c-8a3f8ded2dd6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:34.120466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a05d9-20f7-46f6-a22c-8a3f8ded2dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:34.120718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6a05d9-20f7-46f6-a22c-8a3f8ded2dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:34.214284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2f6a05d9-20f7-46f6-a22c-8a3f8ded2dd6 None None] MFA Rules not processed for user `309ebac21dd944029b1de80ba54dd794`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:34.215664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2f6a05d9-20f7-46f6-a22c-8a3f8ded2dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:34.242284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:34.305046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 653/1310] 10.222.0.59 () {58 vars in 1062 bytes} [Thu Aug 18 20:57:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:34.314389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de61ee-04fc-4526-9397-2ad0b1c21e7a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:34.316756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-01de61ee-04fc-4526-9397-2ad0b1c21e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:34.443000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de61ee-04fc-4526-9397-2ad0b1c21e7a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:34.522175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60865d19-f2b9-4121-8bd8-47a27cfc737d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:34.522711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865d19-f2b9-4121-8bd8-47a27cfc737d service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:34.523042 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865d19-f2b9-4121-8bd8-47a27cfc737d service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:34.523316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60865d19-f2b9-4121-8bd8-47a27cfc737d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:34.525552 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-60865d19-f2b9-4121-8bd8-47a27cfc737d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:34.583533 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:34.642344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60865d19-f2b9-4121-8bd8-47a27cfc737d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:34.644447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60865d19-f2b9-4121-8bd8-47a27cfc737d service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:34.664304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 658/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:36.851367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101af368-d4f0-424a-a984-724081d15e88 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:36.851987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101af368-d4f0-424a-a984-724081d15e88 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:36.851987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101af368-d4f0-424a-a984-724081d15e88 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:36.853284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 654/1312] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:36.858732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43404058-0200-4e1d-8ab4-0c505c05d9e0 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:36.859173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43404058-0200-4e1d-8ab4-0c505c05d9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:36.859357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43404058-0200-4e1d-8ab4-0c505c05d9e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:36.947891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-43404058-0200-4e1d-8ab4-0c505c05d9e0 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:36.949134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-43404058-0200-4e1d-8ab4-0c505c05d9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:37.047767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 659/1313] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:57:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:37.332150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101af368-d4f0-424a-a984-724081d15e88 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:37.334610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-101af368-d4f0-424a-a984-724081d15e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:37.448678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101af368-d4f0-424a-a984-724081d15e88 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:37.530147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:37.533388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb0123a-0b03-45fc-9ced-56be659f3648 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:37.534078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0123a-0b03-45fc-9ced-56be659f3648 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:37.534360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0123a-0b03-45fc-9ced-56be659f3648 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:37.534631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb0123a-0b03-45fc-9ced-56be659f3648 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:37.537412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bfb0123a-0b03-45fc-9ced-56be659f3648 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:37.660439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0123a-0b03-45fc-9ced-56be659f3648 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:37.661814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb0123a-0b03-45fc-9ced-56be659f3648 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:37.681650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 655/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:39.971408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6909c25-fcdb-4807-9243-6c1ddf98fb2a None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:39.971990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6909c25-fcdb-4807-9243-6c1ddf98fb2a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:39.971990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6909c25-fcdb-4807-9243-6c1ddf98fb2a None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:39.973312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 660/1315] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:39.979679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc6b1d-4d47-46a7-a73d-f3749ac13372 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:39.980478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc6b1d-4d47-46a7-a73d-f3749ac13372 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:39.980638 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc6b1d-4d47-46a7-a73d-f3749ac13372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:40.062913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bebc6b1d-4d47-46a7-a73d-f3749ac13372 None None] MFA Rules not processed for user `6453843cc76c4736b0fd2c86281afa8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:40.064098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bebc6b1d-4d47-46a7-a73d-f3749ac13372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:40.116781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:40.168458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 656/1316] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:57:39 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:40.454731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6909c25-fcdb-4807-9243-6c1ddf98fb2a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:40.456742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b6909c25-fcdb-4807-9243-6c1ddf98fb2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:40.467638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:40.573760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6909c25-fcdb-4807-9243-6c1ddf98fb2a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:40.653277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43425556-dd58-41cf-9766-dc9edc7ca351 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:40.653899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43425556-dd58-41cf-9766-dc9edc7ca351 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:40.654180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43425556-dd58-41cf-9766-dc9edc7ca351 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:40.654443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43425556-dd58-41cf-9766-dc9edc7ca351 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:40.656111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-43425556-dd58-41cf-9766-dc9edc7ca351 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:40.731523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:40.783867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43425556-dd58-41cf-9766-dc9edc7ca351 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:40.785932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43425556-dd58-41cf-9766-dc9edc7ca351 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:40.810310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 661/1317] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:40 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:43.348841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1830d-7f15-4433-a9a6-8fd29a2ad8a0 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:43.349722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1830d-7f15-4433-a9a6-8fd29a2ad8a0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:43.349722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d1830d-7f15-4433-a9a6-8fd29a2ad8a0 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:43.352038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 657/1318] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:57:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:43.361221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93247168-08e4-4424-9f5e-23f1b521c745 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:43.361871 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93247168-08e4-4424-9f5e-23f1b521c745 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:43.362114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93247168-08e4-4424-9f5e-23f1b521c745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:43.440219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-93247168-08e4-4424-9f5e-23f1b521c745 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:43.441577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-93247168-08e4-4424-9f5e-23f1b521c745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:43.542177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 662/1319] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:57:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:43.834582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1830d-7f15-4433-a9a6-8fd29a2ad8a0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:43.836184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-65d1830d-7f15-4433-a9a6-8fd29a2ad8a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:43.952442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d1830d-7f15-4433-a9a6-8fd29a2ad8a0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:44.032796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71781ed7-9948-4005-88c3-aeb50cccb017 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:44.033318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71781ed7-9948-4005-88c3-aeb50cccb017 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:44.033588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71781ed7-9948-4005-88c3-aeb50cccb017 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:44.033854 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71781ed7-9948-4005-88c3-aeb50cccb017 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:44.035712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-71781ed7-9948-4005-88c3-aeb50cccb017 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:44.043406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:44.152344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71781ed7-9948-4005-88c3-aeb50cccb017 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:44.153789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71781ed7-9948-4005-88c3-aeb50cccb017 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:44.172248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 658/1320] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:46.748589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34fcb-ece2-46c4-bd85-627c9e1a7774 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:46.749176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34fcb-ece2-46c4-bd85-627c9e1a7774 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:46.749176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d34fcb-ece2-46c4-bd85-627c9e1a7774 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:46.750487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 663/1321] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:57:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:46.756449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9d448-11d5-4ac6-8b5f-b0597f77f3bc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:46.756878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9d448-11d5-4ac6-8b5f-b0597f77f3bc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:46.757359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d9d448-11d5-4ac6-8b5f-b0597f77f3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:46.829107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-00d9d448-11d5-4ac6-8b5f-b0597f77f3bc None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:46.830304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-00d9d448-11d5-4ac6-8b5f-b0597f77f3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:46.888900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:46.928727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 659/1322] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:57:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:57:47.223747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84078c97-f7a6-4574-90cf-6c12b136127b None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:47.223972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84078c97-f7a6-4574-90cf-6c12b136127b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:47.224272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84078c97-f7a6-4574-90cf-6c12b136127b None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:47.225618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 664/1323] 10.222.0.59 () {54 vars in 965 bytes} [Thu Aug 18 20:57:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:47.232519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b366ec6-7f4b-405e-9898-0f8c35bc4eb4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:47.232808 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b366ec6-7f4b-405e-9898-0f8c35bc4eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:47.233081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b366ec6-7f4b-405e-9898-0f8c35bc4eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:47.311373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6b366ec6-7f4b-405e-9898-0f8c35bc4eb4 None None] MFA Rules not processed for user `309ebac21dd944029b1de80ba54dd794`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:47.312597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6b366ec6-7f4b-405e-9898-0f8c35bc4eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:47.390819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 660/1324] 10.222.0.59 () {58 vars in 1062 bytes} [Thu Aug 18 20:57:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:47.400365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84078c97-f7a6-4574-90cf-6c12b136127b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:47.402182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-84078c97-f7a6-4574-90cf-6c12b136127b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:47.422265 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:47.513070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84078c97-f7a6-4574-90cf-6c12b136127b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:47.591690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2a835-fed9-418d-97a6-7c5c409039de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:47.592476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2a835-fed9-418d-97a6-7c5c409039de service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:47.592749 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2a835-fed9-418d-97a6-7c5c409039de service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:47.593014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2a835-fed9-418d-97a6-7c5c409039de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:47.594618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d0c2a835-fed9-418d-97a6-7c5c409039de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:47.674060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:47.716258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2a835-fed9-418d-97a6-7c5c409039de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:47.717704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2a835-fed9-418d-97a6-7c5c409039de service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:47.737748 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 665/1325] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:49.950807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85737a7-06e4-4b83-a8ec-723df1a74c46 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:49.951364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85737a7-06e4-4b83-a8ec-723df1a74c46 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:49.951364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85737a7-06e4-4b83-a8ec-723df1a74c46 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:49.952731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 661/1326] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:57:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:49.958350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b46c-ec97-43b3-9b04-db782d6e0721 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:49.958813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b46c-ec97-43b3-9b04-db782d6e0721 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:49.959045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e371b46c-ec97-43b3-9b04-db782d6e0721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:50.030022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-e371b46c-ec97-43b3-9b04-db782d6e0721 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:50.031192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e371b46c-ec97-43b3-9b04-db782d6e0721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:50.143898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 666/1327] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:57:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:50.424480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85737a7-06e4-4b83-a8ec-723df1a74c46 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:50.426605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e85737a7-06e4-4b83-a8ec-723df1a74c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:50.491049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:50.537673 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85737a7-06e4-4b83-a8ec-723df1a74c46 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:50.614891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe0c0da-95ac-4748-9533-841b32039764 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:50.615511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0c0da-95ac-4748-9533-841b32039764 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:50.615883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0c0da-95ac-4748-9533-841b32039764 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:50.616156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe0c0da-95ac-4748-9533-841b32039764 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:50.617812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dfe0c0da-95ac-4748-9533-841b32039764 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:50.730121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:50.732940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0c0da-95ac-4748-9533-841b32039764 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:50.734829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe0c0da-95ac-4748-9533-841b32039764 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:50.756234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 662/1328] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:52.750279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8becb-db62-436f-8413-5348261fd658 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:52.750868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8becb-db62-436f-8413-5348261fd658 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:52.750868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff8becb-db62-436f-8413-5348261fd658 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:52.752235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 667/1329] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:57:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:52.757962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7deea8-4e31-4441-b979-54bc9dc0731d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:52.758481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7deea8-4e31-4441-b979-54bc9dc0731d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:52.758481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7deea8-4e31-4441-b979-54bc9dc0731d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:52.831186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7d7deea8-4e31-4441-b979-54bc9dc0731d None None] MFA Rules not processed for user `6453843cc76c4736b0fd2c86281afa8e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:52.832517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7d7deea8-4e31-4441-b979-54bc9dc0731d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:52.937402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 663/1330] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:57:52 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:53.225484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8becb-db62-436f-8413-5348261fd658 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:53.227091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3ff8becb-db62-436f-8413-5348261fd658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:53.262541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:53.340063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff8becb-db62-436f-8413-5348261fd658 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:53.421487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7cdad8-c493-45f4-b0d1-6c3b4965c73a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:53.422114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cdad8-c493-45f4-b0d1-6c3b4965c73a service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:53.422386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cdad8-c493-45f4-b0d1-6c3b4965c73a service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:53.422650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7cdad8-c493-45f4-b0d1-6c3b4965c73a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:53.424374 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-aa7cdad8-c493-45f4-b0d1-6c3b4965c73a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:53.508425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:53.542235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cdad8-c493-45f4-b0d1-6c3b4965c73a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:53.543740 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7cdad8-c493-45f4-b0d1-6c3b4965c73a service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:53.562900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 668/1331] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:53 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:55.970843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98541e2c-fad1-4fc7-b610-0cca1bf88474 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:55.971748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98541e2c-fad1-4fc7-b610-0cca1bf88474 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:55.971748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98541e2c-fad1-4fc7-b610-0cca1bf88474 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:55.974013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 664/1332] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:57:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:55.979719 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92568371-33e5-464e-929c-3976f742fe0a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:55.980143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92568371-33e5-464e-929c-3976f742fe0a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:55.980253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92568371-33e5-464e-929c-3976f742fe0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:56.049157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-92568371-33e5-464e-929c-3976f742fe0a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:56.050284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-92568371-33e5-464e-929c-3976f742fe0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:56.162952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 669/1333] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:57:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:56.462204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98541e2c-fad1-4fc7-b610-0cca1bf88474 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:56.464664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-98541e2c-fad1-4fc7-b610-0cca1bf88474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:56.556096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:56.593143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98541e2c-fad1-4fc7-b610-0cca1bf88474 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:56.676668 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463a2c41-e370-47fc-add0-f7623486dcbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:56.677283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a2c41-e370-47fc-add0-f7623486dcbe service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:56.677557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a2c41-e370-47fc-add0-f7623486dcbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:56.677824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463a2c41-e370-47fc-add0-f7623486dcbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:56.679461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-463a2c41-e370-47fc-add0-f7623486dcbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:56.799340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a2c41-e370-47fc-add0-f7623486dcbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:56.800783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463a2c41-e370-47fc-add0-f7623486dcbe service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:56.811052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:56.820767 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 665/1334] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:57:58.765608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24652a50-757c-4d70-82a0-f83c619ceae9 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:58.766204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24652a50-757c-4d70-82a0-f83c619ceae9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:58.766204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24652a50-757c-4d70-82a0-f83c619ceae9 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:58.767548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 670/1335] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:57:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:57:58.773759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2bc9d-42d2-4c8a-bedb-dc5274b09a5c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:58.774259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2bc9d-42d2-4c8a-bedb-dc5274b09a5c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:58.774259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab2bc9d-42d2-4c8a-bedb-dc5274b09a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:58.845602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4ab2bc9d-42d2-4c8a-bedb-dc5274b09a5c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:57:58.846809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4ab2bc9d-42d2-4c8a-bedb-dc5274b09a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:58.945805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 666/1336] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:57:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:57:59.233431 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24652a50-757c-4d70-82a0-f83c619ceae9 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:57:59.235963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-24652a50-757c-4d70-82a0-f83c619ceae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:59.284773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:59.365158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24652a50-757c-4d70-82a0-f83c619ceae9 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:57:59.443010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6205fbb9-57d2-4e3a-9941-352e0b2e0ade service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:57:59.443623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205fbb9-57d2-4e3a-9941-352e0b2e0ade service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:57:59.443899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205fbb9-57d2-4e3a-9941-352e0b2e0ade service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:57:59.444169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6205fbb9-57d2-4e3a-9941-352e0b2e0ade service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:57:59.445774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6205fbb9-57d2-4e3a-9941-352e0b2e0ade service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:57:59.547817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:57:59.578601 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205fbb9-57d2-4e3a-9941-352e0b2e0ade service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:57:59.580093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6205fbb9-57d2-4e3a-9941-352e0b2e0ade service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:57:59.599918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 671/1337] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:57:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:01.873597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72454b0-b014-41d2-8bd5-86d2d774586b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:01.874241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72454b0-b014-41d2-8bd5-86d2d774586b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:01.874241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72454b0-b014-41d2-8bd5-86d2d774586b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:01.875537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 667/1338] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:01.881262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6aaa-2223-4f6d-8285-85e632005902 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:01.881959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6aaa-2223-4f6d-8285-85e632005902 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:01.882105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6aaa-2223-4f6d-8285-85e632005902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:01.967202 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-8e4e6aaa-2223-4f6d-8285-85e632005902 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:01.968428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8e4e6aaa-2223-4f6d-8285-85e632005902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:02.075154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 672/1339] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:58:02.374823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72454b0-b014-41d2-8bd5-86d2d774586b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:02.376436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d72454b0-b014-41d2-8bd5-86d2d774586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:02.472043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:02.502037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72454b0-b014-41d2-8bd5-86d2d774586b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:02.579033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182bfeb3-9605-422a-b049-9bf63793ce29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:02.579650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bfeb3-9605-422a-b049-9bf63793ce29 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:02.579929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bfeb3-9605-422a-b049-9bf63793ce29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:02.580197 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182bfeb3-9605-422a-b049-9bf63793ce29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:02.581833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-182bfeb3-9605-422a-b049-9bf63793ce29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:02.701596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bfeb3-9605-422a-b049-9bf63793ce29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:02.702993 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182bfeb3-9605-422a-b049-9bf63793ce29 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:02.721770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 668/1340] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:02 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:06.663177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddd34f-881d-42c5-9efb-083d74728992 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:06.663177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddd34f-881d-42c5-9efb-083d74728992 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:06.663177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddd34f-881d-42c5-9efb-083d74728992 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:06.664494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 673/1341] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:58:06.669715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db472f-9061-46fb-b71e-460daf9e4cec None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:06.670199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db472f-9061-46fb-b71e-460daf9e4cec None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:06.670296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db472f-9061-46fb-b71e-460daf9e4cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:06.676079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:06.742400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e2db472f-9061-46fb-b71e-460daf9e4cec None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:06.743644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e2db472f-9061-46fb-b71e-460daf9e4cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:06.850094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 669/1342] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:58:07.131029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddd34f-881d-42c5-9efb-083d74728992 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:07.132695 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-1dddd34f-881d-42c5-9efb-083d74728992 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:07.186385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:07.246872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddd34f-881d-42c5-9efb-083d74728992 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:07.325471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c2ec42-1ee5-4e59-bca6-76b233f43e20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:07.326115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ec42-1ee5-4e59-bca6-76b233f43e20 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:07.326388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ec42-1ee5-4e59-bca6-76b233f43e20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:07.326671 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c2ec42-1ee5-4e59-bca6-76b233f43e20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:07.328296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e8c2ec42-1ee5-4e59-bca6-76b233f43e20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:07.430955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:07.448529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2ec42-1ee5-4e59-bca6-76b233f43e20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:07.449988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c2ec42-1ee5-4e59-bca6-76b233f43e20 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:07.469570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 674/1343] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:10.026599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebd4a5-9c53-40a7-a6bc-7e12f4c9138c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:10.027128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebd4a5-9c53-40a7-a6bc-7e12f4c9138c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:10.027128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eebd4a5-9c53-40a7-a6bc-7e12f4c9138c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:10.028471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 670/1344] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:10.034572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b54a1-5209-43ae-9721-0f93b9418ad0 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:10.035195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b54a1-5209-43ae-9721-0f93b9418ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:10.035464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17b54a1-5209-43ae-9721-0f93b9418ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:10.105996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-c17b54a1-5209-43ae-9721-0f93b9418ad0 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:10.107566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c17b54a1-5209-43ae-9721-0f93b9418ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:10.209591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 675/1345] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:10.491161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebd4a5-9c53-40a7-a6bc-7e12f4c9138c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:10.492733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1eebd4a5-9c53-40a7-a6bc-7e12f4c9138c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:10.594642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:10.613132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eebd4a5-9c53-40a7-a6bc-7e12f4c9138c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:10.693202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e721c9d5-42f7-4cd3-8cb2-5a9695cab804 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:10.693828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721c9d5-42f7-4cd3-8cb2-5a9695cab804 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:10.694101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721c9d5-42f7-4cd3-8cb2-5a9695cab804 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:10.694372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e721c9d5-42f7-4cd3-8cb2-5a9695cab804 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:10.695995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e721c9d5-42f7-4cd3-8cb2-5a9695cab804 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:10.816133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721c9d5-42f7-4cd3-8cb2-5a9695cab804 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:10.817598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e721c9d5-42f7-4cd3-8cb2-5a9695cab804 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:10.836858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 671/1346] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:15.209970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6812c-a36c-4e6e-9c7e-acd39e2e72ec None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.210514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6812c-a36c-4e6e-9c7e-acd39e2e72ec None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.210514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd6812c-a36c-4e6e-9c7e-acd39e2e72ec None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.211938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 676/1347] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:15.217449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cbccd-1100-48d1-adca-d8fe2d87b780 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.217969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cbccd-1100-48d1-adca-d8fe2d87b780 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.217969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059cbccd-1100-48d1-adca-d8fe2d87b780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.237253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:15.298656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-059cbccd-1100-48d1-adca-d8fe2d87b780 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:15.299932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-059cbccd-1100-48d1-adca-d8fe2d87b780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:15.408473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 672/1348] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:15.691542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6812c-a36c-4e6e-9c7e-acd39e2e72ec None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:15.693982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4dd6812c-a36c-4e6e-9c7e-acd39e2e72ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:15.759289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:15.814197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd6812c-a36c-4e6e-9c7e-acd39e2e72ec None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:15.896125 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d42b9b4-cbe9-44b4-be75-d6309a788df7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:15.896647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b9b4-cbe9-44b4-be75-d6309a788df7 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:15.896919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b9b4-cbe9-44b4-be75-d6309a788df7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:15.897182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d42b9b4-cbe9-44b4-be75-d6309a788df7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:15.898800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8d42b9b4-cbe9-44b4-be75-d6309a788df7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:16.025245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:16.029791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42b9b4-cbe9-44b4-be75-d6309a788df7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:16.032326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d42b9b4-cbe9-44b4-be75-d6309a788df7 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:16.059775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 677/1349] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:21.045991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b653d2-1bd0-4458-bce5-d28ed5fda1c3 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.046938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b653d2-1bd0-4458-bce5-d28ed5fda1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.046938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b653d2-1bd0-4458-bce5-d28ed5fda1c3 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.047981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 673/1350] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 20:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:21.053521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac40f-7f21-44a8-b531-f790a69dc6d1 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:21.054548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac40f-7f21-44a8-b531-f790a69dc6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:21.054995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fac40f-7f21-44a8-b531-f790a69dc6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:21.146386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-09fac40f-7f21-44a8-b531-f790a69dc6d1 None None] MFA Rules not processed for user `16a4ba52fe124009a570fd1408903cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:21.147788 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-09fac40f-7f21-44a8-b531-f790a69dc6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:21.302231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 678/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 20:58:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:25.377115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3663-0aa5-4072-8296-f7fd5f0c3dc5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:25.377660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3663-0aa5-4072-8296-f7fd5f0c3dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:25.377777 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcb3663-0aa5-4072-8296-f7fd5f0c3dc5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:25.379777 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 674/1352] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 20:58:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:25.385566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a1e9-0e3a-461c-946c-c4d7cf4e6cfb None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:25.386017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a1e9-0e3a-461c-946c-c4d7cf4e6cfb None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:25.386148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e85a1e9-0e3a-461c-946c-c4d7cf4e6cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:25.406598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=59 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:25.445652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:25.469783 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-6e85a1e9-0e3a-461c-946c-c4d7cf4e6cfb None None] MFA Rules not processed for user `16a4ba52fe124009a570fd1408903cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:25.471065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6e85a1e9-0e3a-461c-946c-c4d7cf4e6cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:25.585563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 679/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 20:58:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:27.100712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d9822-296c-49c7-a146-349eb991d74e None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.101260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d9822-296c-49c7-a146-349eb991d74e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.101260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d9822-296c-49c7-a146-349eb991d74e None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.102537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 675/1354] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 20:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:27.107839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292738-cfbf-4089-897e-09fab17a8b41 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:27.108279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292738-cfbf-4089-897e-09fab17a8b41 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:27.108537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74292738-cfbf-4089-897e-09fab17a8b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:27.194445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-74292738-cfbf-4089-897e-09fab17a8b41 None None] MFA Rules not processed for user `16a4ba52fe124009a570fd1408903cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:27.195737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-74292738-cfbf-4089-897e-09fab17a8b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:27.242481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:27.314814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 680/1355] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 20:58:27 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:30.664305 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3d600-213c-4c84-922b-12f5ffd370e8 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:30.664867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3d600-213c-4c84-922b-12f5ffd370e8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:30.664867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f3d600-213c-4c84-922b-12f5ffd370e8 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:30.666629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 676/1356] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:30.671762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a64ef8-3d99-4fec-ba5c-3b5dec7c0a21 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:30.672191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a64ef8-3d99-4fec-ba5c-3b5dec7c0a21 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:30.672456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a64ef8-3d99-4fec-ba5c-3b5dec7c0a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:30.765605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-66a64ef8-3d99-4fec-ba5c-3b5dec7c0a21 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:30.767342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-66a64ef8-3d99-4fec-ba5c-3b5dec7c0a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:30.883367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 681/1357] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:31.192248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8f6d-1851-45e5-a1c6-809a8bfe868b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:31.192837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8f6d-1851-45e5-a1c6-809a8bfe868b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:31.193314 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ba8f6d-1851-45e5-a1c6-809a8bfe868b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:31.195401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 677/1358] 10.222.0.59 () {54 vars in 962 bytes} [Thu Aug 18 20:58:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:31.203668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455fe7-b8c1-46cc-8c11-756ee7f1555e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:31.204252 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455fe7-b8c1-46cc-8c11-756ee7f1555e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:31.204744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2455fe7-b8c1-46cc-8c11-756ee7f1555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:31.230072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:31.297125 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-a2455fe7-b8c1-46cc-8c11-756ee7f1555e None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:31.298427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a2455fe7-b8c1-46cc-8c11-756ee7f1555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:31.426809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 682/1359] 10.222.0.59 () {58 vars in 1059 bytes} [Thu Aug 18 20:58:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:31.435510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba8f6d-1851-45e5-a1c6-809a8bfe868b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:31.437024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-18ba8f6d-1851-45e5-a1c6-809a8bfe868b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:31.597556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ba8f6d-1851-45e5-a1c6-809a8bfe868b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:31.676515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:31.718206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9730cf-4645-4c8d-99a1-eab42269ad4c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:31.718832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9730cf-4645-4c8d-99a1-eab42269ad4c service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:31.719114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9730cf-4645-4c8d-99a1-eab42269ad4c service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:31.719383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9730cf-4645-4c8d-99a1-eab42269ad4c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:31.720969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3d9730cf-4645-4c8d-99a1-eab42269ad4c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:31.819021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9730cf-4645-4c8d-99a1-eab42269ad4c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:31.820893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9730cf-4645-4c8d-99a1-eab42269ad4c service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:31.840995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 678/1360] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:33.956812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3792-26b8-4219-bbcd-10135fbb608c None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:33.956812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3792-26b8-4219-bbcd-10135fbb608c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:33.957480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cf3792-26b8-4219-bbcd-10135fbb608c None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:33.959080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 683/1361] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:33.965249 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0475-5546-42a8-8650-4ef882ea7e6f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:33.965719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0475-5546-42a8-8650-4ef882ea7e6f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:33.965874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcf0475-5546-42a8-8650-4ef882ea7e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:34.038582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bbcf0475-5546-42a8-8650-4ef882ea7e6f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:34.039842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bbcf0475-5546-42a8-8650-4ef882ea7e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:34.081216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:34.154028 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 679/1362] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:34.441736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf3792-26b8-4219-bbcd-10135fbb608c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:34.443786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f8cf3792-26b8-4219-bbcd-10135fbb608c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:34.511620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:34.595486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cf3792-26b8-4219-bbcd-10135fbb608c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:34.721796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba2a02-40fc-4bfa-8f56-064d2d66c88c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:34.722605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba2a02-40fc-4bfa-8f56-064d2d66c88c service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:34.723483 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba2a02-40fc-4bfa-8f56-064d2d66c88c service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:34.723990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba2a02-40fc-4bfa-8f56-064d2d66c88c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:34.725734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-40ba2a02-40fc-4bfa-8f56-064d2d66c88c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:34.757175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:34.835943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba2a02-40fc-4bfa-8f56-064d2d66c88c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:34.837576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ba2a02-40fc-4bfa-8f56-064d2d66c88c service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:34.857789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 684/1363] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:37.088662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b3717-6503-4c33-8589-ed9315e4db99 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:37.089538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b3717-6503-4c33-8589-ed9315e4db99 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:37.089818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23b3717-6503-4c33-8589-ed9315e4db99 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:37.091297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 680/1364] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:37.096871 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232fbb7-6cbd-4a3a-a694-1da7baeb88e9 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:37.097336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232fbb7-6cbd-4a3a-a694-1da7baeb88e9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:37.097429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8232fbb7-6cbd-4a3a-a694-1da7baeb88e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:37.178080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-8232fbb7-6cbd-4a3a-a694-1da7baeb88e9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:37.179527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8232fbb7-6cbd-4a3a-a694-1da7baeb88e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:37.286354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:37.290823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 685/1365] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:37.590739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274e0d9-7f9c-4c6b-947a-4e57aa9bfeda None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:37.591076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274e0d9-7f9c-4c6b-947a-4e57aa9bfeda None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:37.591487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274e0d9-7f9c-4c6b-947a-4e57aa9bfeda None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:37.593064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 681/1366] 10.222.0.59 () {54 vars in 962 bytes} [Thu Aug 18 20:58:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:37.598539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035aa9b-e732-4abf-8a4b-ac99153ebb9a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:37.598874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035aa9b-e732-4abf-8a4b-ac99153ebb9a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:37.599177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9035aa9b-e732-4abf-8a4b-ac99153ebb9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:37.678396 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-9035aa9b-e732-4abf-8a4b-ac99153ebb9a None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:37.679670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-9035aa9b-e732-4abf-8a4b-ac99153ebb9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:37.821935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 686/1367] 10.222.0.59 () {58 vars in 1059 bytes} [Thu Aug 18 20:58:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:37.829872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274e0d9-7f9c-4c6b-947a-4e57aa9bfeda None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:37.831619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9274e0d9-7f9c-4c6b-947a-4e57aa9bfeda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:37.990858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274e0d9-7f9c-4c6b-947a-4e57aa9bfeda None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:38.013145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:38.129096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d9d0fa-da91-4db7-aa12-9e738a05392a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:38.129892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9d0fa-da91-4db7-aa12-9e738a05392a service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:38.130143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9d0fa-da91-4db7-aa12-9e738a05392a service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:38.130419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d9d0fa-da91-4db7-aa12-9e738a05392a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:38.132079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b2d9d0fa-da91-4db7-aa12-9e738a05392a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:38.225565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9d0fa-da91-4db7-aa12-9e738a05392a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:38.227239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d9d0fa-da91-4db7-aa12-9e738a05392a service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:38.248310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 682/1368] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:38.870914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8a3d-fad2-4d04-a458-77bc693dd49d None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:38.871513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8a3d-fad2-4d04-a458-77bc693dd49d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:38.871513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4a8a3d-fad2-4d04-a458-77bc693dd49d None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:38.873379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 687/1369] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:38.879938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615dff5-b8dd-4382-9541-01de925073c9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:38.880331 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615dff5-b8dd-4382-9541-01de925073c9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:38.880604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3615dff5-b8dd-4382-9541-01de925073c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:38.919873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:38.973090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3615dff5-b8dd-4382-9541-01de925073c9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:38.973090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3615dff5-b8dd-4382-9541-01de925073c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:39.101048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 683/1370] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:58:39.766253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88fc1c-1ee4-459f-b57b-2e9f894c4214 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:39.766543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88fc1c-1ee4-459f-b57b-2e9f894c4214 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:39.766868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88fc1c-1ee4-459f-b57b-2e9f894c4214 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:39.768264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 688/1371] 10.222.0.59 () {54 vars in 964 bytes} [Thu Aug 18 20:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:39.776727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f0dca-dcc7-4d74-a414-e212b483b5ee None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:39.777215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f0dca-dcc7-4d74-a414-e212b483b5ee None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:39.777215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5f0dca-dcc7-4d74-a414-e212b483b5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:39.858988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6d5f0dca-dcc7-4d74-a414-e212b483b5ee None None] MFA Rules not processed for user `7b93049bc8aa47648d101a3f937ca8db`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:39.860316 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6d5f0dca-dcc7-4d74-a414-e212b483b5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:39.912364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:39.945383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 684/1372] 10.222.0.59 () {58 vars in 1061 bytes} [Thu Aug 18 20:58:39 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:39.952989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88fc1c-1ee4-459f-b57b-2e9f894c4214 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:39.954721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8f88fc1c-1ee4-459f-b57b-2e9f894c4214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:40.013696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:40.103000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88fc1c-1ee4-459f-b57b-2e9f894c4214 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:40.191456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b89a3-7e04-4a04-8a62-38c15f061ac6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:40.192146 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b89a3-7e04-4a04-8a62-38c15f061ac6 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:40.192570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b89a3-7e04-4a04-8a62-38c15f061ac6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:40.193050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b89a3-7e04-4a04-8a62-38c15f061ac6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:40.194537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-161b89a3-7e04-4a04-8a62-38c15f061ac6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:40.255918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db383cd-9e96-4d3f-905b-47592839efc1 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:40.256217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db383cd-9e96-4d3f-905b-47592839efc1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:40.257007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db383cd-9e96-4d3f-905b-47592839efc1 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:40.258110 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 685/1373] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:40.263105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35f5f-33fb-45da-9a98-4df9d7985d72 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:40.263453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35f5f-33fb-45da-9a98-4df9d7985d72 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:40.266544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb35f5f-33fb-45da-9a98-4df9d7985d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:40.306318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:40.325926 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b89a3-7e04-4a04-8a62-38c15f061ac6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:40.327541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161b89a3-7e04-4a04-8a62-38c15f061ac6 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:40.351552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3fb35f5f-33fb-45da-9a98-4df9d7985d72 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:40.352208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3fb35f5f-33fb-45da-9a98-4df9d7985d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:40.352415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 689/1374] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:40.468414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 686/1375] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:58:40.754570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b89a3-7e04-4a04-8a62-38c15f061ac6 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:40.755888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-161b89a3-7e04-4a04-8a62-38c15f061ac6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:40.858681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b89a3-7e04-4a04-8a62-38c15f061ac6 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:40.969000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:40.983769 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fde1cf-8d37-4eab-afbf-cde95504afad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:40.984389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fde1cf-8d37-4eab-afbf-cde95504afad service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:40.984654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fde1cf-8d37-4eab-afbf-cde95504afad service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:40.984937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fde1cf-8d37-4eab-afbf-cde95504afad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:40.986564 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d7fde1cf-8d37-4eab-afbf-cde95504afad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:41.081490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fde1cf-8d37-4eab-afbf-cde95504afad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:41.083169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fde1cf-8d37-4eab-afbf-cde95504afad service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:41.101236 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 690/1376] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:43.046612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b604-eb39-45ae-9f48-89cfc56e0a72 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:43.047189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b604-eb39-45ae-9f48-89cfc56e0a72 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:43.047189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d12b604-eb39-45ae-9f48-89cfc56e0a72 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:43.048505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 687/1377] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:43.054118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92a2b6-e0ad-49be-8ea5-f99256289397 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:43.054583 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92a2b6-e0ad-49be-8ea5-f99256289397 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:43.054691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac92a2b6-e0ad-49be-8ea5-f99256289397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:43.125315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ac92a2b6-e0ad-49be-8ea5-f99256289397 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:43.126508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ac92a2b6-e0ad-49be-8ea5-f99256289397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:43.188176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:43.227545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 691/1378] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:43.516441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12b604-eb39-45ae-9f48-89cfc56e0a72 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:43.517984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7d12b604-eb39-45ae-9f48-89cfc56e0a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:43.571614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:43.677084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d12b604-eb39-45ae-9f48-89cfc56e0a72 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:43.838022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20241c8-260a-46b2-916a-be19586957ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:43.839364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20241c8-260a-46b2-916a-be19586957ff service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:43.839651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20241c8-260a-46b2-916a-be19586957ff service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:43.840060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20241c8-260a-46b2-916a-be19586957ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:43.841874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f20241c8-260a-46b2-916a-be19586957ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:43.862357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:43.959752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20241c8-260a-46b2-916a-be19586957ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:43.961393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20241c8-260a-46b2-916a-be19586957ff service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:43.981019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 688/1379] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:45.966764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986513-1387-4040-b15d-6daf2431bc9b None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:45.967372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986513-1387-4040-b15d-6daf2431bc9b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:45.967372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32986513-1387-4040-b15d-6daf2431bc9b None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:45.968786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 692/1380] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:45.974325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5373794-f518-4be8-bb05-dc998831fd81 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:45.974764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5373794-f518-4be8-bb05-dc998831fd81 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:45.974985 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5373794-f518-4be8-bb05-dc998831fd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:46.043602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d5373794-f518-4be8-bb05-dc998831fd81 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:46.044871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d5373794-f518-4be8-bb05-dc998831fd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:46.133831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:46.151036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 689/1381] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:46.441148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32986513-1387-4040-b15d-6daf2431bc9b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:46.443168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-32986513-1387-4040-b15d-6daf2431bc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:46.601526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32986513-1387-4040-b15d-6daf2431bc9b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:46.660397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:46.743754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f3cce-2483-487e-8e38-e3add45ad0eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:46.744355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3cce-2483-487e-8e38-e3add45ad0eb service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:46.744652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3cce-2483-487e-8e38-e3add45ad0eb service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:46.744895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f3cce-2483-487e-8e38-e3add45ad0eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:46.746568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4c8f3cce-2483-487e-8e38-e3add45ad0eb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:46.850087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f3cce-2483-487e-8e38-e3add45ad0eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:46.851737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f3cce-2483-487e-8e38-e3add45ad0eb service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:46.871623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 693/1382] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:48.809498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7808f-b709-4dab-b16a-6bfe6a62c5d5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:48.809954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7808f-b709-4dab-b16a-6bfe6a62c5d5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:48.810165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a7808f-b709-4dab-b16a-6bfe6a62c5d5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:48.811434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 690/1383] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:48.817408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928069e9-00e5-4dd3-99f7-dd82f426c64e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:48.818178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928069e9-00e5-4dd3-99f7-dd82f426c64e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:48.818459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928069e9-00e5-4dd3-99f7-dd82f426c64e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:48.901408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-928069e9-00e5-4dd3-99f7-dd82f426c64e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:48.903062 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-928069e9-00e5-4dd3-99f7-dd82f426c64e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:48.905666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:49.042183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 694/1384] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:49.327227 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7808f-b709-4dab-b16a-6bfe6a62c5d5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:49.328762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f5a7808f-b709-4dab-b16a-6bfe6a62c5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:49.495343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a7808f-b709-4dab-b16a-6bfe6a62c5d5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:49.564437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:49.619035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fba869-9817-4986-89b6-90d753bd2b40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:49.619674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba869-9817-4986-89b6-90d753bd2b40 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:49.619943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba869-9817-4986-89b6-90d753bd2b40 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:49.620208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fba869-9817-4986-89b6-90d753bd2b40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:49.621823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b9fba869-9817-4986-89b6-90d753bd2b40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:49.716456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fba869-9817-4986-89b6-90d753bd2b40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:49.718087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fba869-9817-4986-89b6-90d753bd2b40 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:49.736562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 691/1385] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:51.994791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bfcec-d625-4efd-808c-741cb9d53ffb None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:51.995400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bfcec-d625-4efd-808c-741cb9d53ffb None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:51.995595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561bfcec-d625-4efd-808c-741cb9d53ffb None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:51.997497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 695/1386] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:52.004999 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3752e-ee6b-468b-847c-1be2465afada None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:52.006063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3752e-ee6b-468b-847c-1be2465afada None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:52.006446 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3752e-ee6b-468b-847c-1be2465afada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:52.095868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-44d3752e-ee6b-468b-847c-1be2465afada None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:52.097055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-44d3752e-ee6b-468b-847c-1be2465afada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:52.129454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:52.208044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 692/1387] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:52.500019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bfcec-d625-4efd-808c-741cb9d53ffb None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:52.501558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-561bfcec-d625-4efd-808c-741cb9d53ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:52.639753 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:52.658282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561bfcec-d625-4efd-808c-741cb9d53ffb None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:52.914228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121a7aef-c862-4b13-9de7-1cd46fc5d251 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:52.915009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a7aef-c862-4b13-9de7-1cd46fc5d251 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:52.915284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a7aef-c862-4b13-9de7-1cd46fc5d251 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:52.915549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121a7aef-c862-4b13-9de7-1cd46fc5d251 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:52.917133 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-121a7aef-c862-4b13-9de7-1cd46fc5d251 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:53.012594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a7aef-c862-4b13-9de7-1cd46fc5d251 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:53.014376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121a7aef-c862-4b13-9de7-1cd46fc5d251 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:53.019798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:53.035359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 696/1388] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:54.989689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13783-29c1-4d51-bc7d-3d885a92d5a8 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:54.990186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13783-29c1-4d51-bc7d-3d885a92d5a8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:54.990391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a13783-29c1-4d51-bc7d-3d885a92d5a8 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:54.991803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 693/1389] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:54.997248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0d19-f4f1-42bd-912c-12d281220b11 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:54.997689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0d19-f4f1-42bd-912c-12d281220b11 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:54.997784 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561c0d19-f4f1-42bd-912c-12d281220b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:55.066243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-561c0d19-f4f1-42bd-912c-12d281220b11 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:55.067400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-561c0d19-f4f1-42bd-912c-12d281220b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:55.166156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 697/1390] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:55.411963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182afc-d62f-407c-bc1f-6228714d919c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:55.411963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182afc-d62f-407c-bc1f-6228714d919c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:55.412258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a182afc-d62f-407c-bc1f-6228714d919c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:55.413487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 694/1391] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:55.418980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ab620-8cdb-48e5-b11c-9f05652971af None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:55.419244 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ab620-8cdb-48e5-b11c-9f05652971af None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:55.419545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1ab620-8cdb-48e5-b11c-9f05652971af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:55.452922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182afc-d62f-407c-bc1f-6228714d919c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:55.454630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8a182afc-d62f-407c-bc1f-6228714d919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:55.489660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-6d1ab620-8cdb-48e5-b11c-9f05652971af None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:55.490929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6d1ab620-8cdb-48e5-b11c-9f05652971af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:55.511623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:55.596116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 698/1392] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:58:55.611840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a182afc-d62f-407c-bc1f-6228714d919c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:55.621688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:55.727136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb2b55e-7955-420a-afa4-82a2491b2c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:55.727832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b55e-7955-420a-afa4-82a2491b2c0b service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:55.728105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b55e-7955-420a-afa4-82a2491b2c0b service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:55.728370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb2b55e-7955-420a-afa4-82a2491b2c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:55.729960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dcb2b55e-7955-420a-afa4-82a2491b2c0b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:55.821501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2b55e-7955-420a-afa4-82a2491b2c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:55.823178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb2b55e-7955-420a-afa4-82a2491b2c0b service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:55.842118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 695/1393] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:58:55.904968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd7b91-c1a1-42fa-b0e1-6e963716e32f None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:55.905222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd7b91-c1a1-42fa-b0e1-6e963716e32f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:55.905650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd7b91-c1a1-42fa-b0e1-6e963716e32f None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:55.907267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 699/1394] 10.222.0.59 () {54 vars in 967 bytes} [Thu Aug 18 20:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:58:55.912478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1685cf-bb51-47fa-a995-e6ac1ae1e64d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:55.912761 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1685cf-bb51-47fa-a995-e6ac1ae1e64d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:55.913031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1685cf-bb51-47fa-a995-e6ac1ae1e64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:55.931071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:56.004669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1d1685cf-bb51-47fa-a995-e6ac1ae1e64d None None] MFA Rules not processed for user `7074acac73904bab8399f223bd662863`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:56.005902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1d1685cf-bb51-47fa-a995-e6ac1ae1e64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:56.090840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 696/1395] 10.222.0.59 () {58 vars in 1064 bytes} [Thu Aug 18 20:58:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:56.098688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd7b91-c1a1-42fa-b0e1-6e963716e32f None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:56.100483 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d1dd7b91-c1a1-42fa-b0e1-6e963716e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:56.210020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd7b91-c1a1-42fa-b0e1-6e963716e32f None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:56.273927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:56.303547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a133ee4-9808-4f21-9ced-38100ac38455 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7074acac73904bab8399f223bd662863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:56.304480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a133ee4-9808-4f21-9ced-38100ac38455 service glance] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:56.304942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a133ee4-9808-4f21-9ced-38100ac38455 service glance] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:56.305366 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a133ee4-9808-4f21-9ced-38100ac38455 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:56.307046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-9a133ee4-9808-4f21-9ced-38100ac38455 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:56.422049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a133ee4-9808-4f21-9ced-38100ac38455 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:56.423554 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a133ee4-9808-4f21-9ced-38100ac38455 service glance] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:56.442873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 700/1396] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 20:58:57.197377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73359-dff5-4111-ab63-03890f2ad786 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:57.197898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73359-dff5-4111-ab63-03890f2ad786 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:57.198013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf73359-dff5-4111-ab63-03890f2ad786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:57.272168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fdf73359-dff5-4111-ab63-03890f2ad786 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:57.273403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fdf73359-dff5-4111-ab63-03890f2ad786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:57.335328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:57.369815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 697/1397] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:57.417785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32ef83-b7bd-4b45-b663-63c2a0ec2fc2 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:57.418269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32ef83-b7bd-4b45-b663-63c2a0ec2fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:57.418360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f32ef83-b7bd-4b45-b663-63c2a0ec2fc2 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:57.419865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 701/1398] 10.222.0.59 () {54 vars in 943 bytes} [Thu Aug 18 20:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:57.426179 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bb643-fe0f-4f24-9e64-20f5bc27c6bd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:57.426466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bb643-fe0f-4f24-9e64-20f5bc27c6bd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:57.426742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091bb643-fe0f-4f24-9e64-20f5bc27c6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:57.505914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-091bb643-fe0f-4f24-9e64-20f5bc27c6bd None None] MFA Rules not processed for user `410e8bceb7664e1d9968f85f41cc0828`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:57.507233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-091bb643-fe0f-4f24-9e64-20f5bc27c6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:57.616895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 698/1399] 10.222.0.59 () {58 vars in 1040 bytes} [Thu Aug 18 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:58:57.626819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32ef83-b7bd-4b45-b663-63c2a0ec2fc2 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:57.628698 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-9f32ef83-b7bd-4b45-b663-63c2a0ec2fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:57.711141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:57.768131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f32ef83-b7bd-4b45-b663-63c2a0ec2fc2 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:57.805160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9cfa4-76ab-4fd2-b040-67d4153cdef0 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:57.805445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9cfa4-76ab-4fd2-b040-67d4153cdef0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:57.805713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9cfa4-76ab-4fd2-b040-67d4153cdef0 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:57.807512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 699/1400] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:58:57.812062 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d26a-0113-4d3f-be7c-425887d54c7b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:57.812336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d26a-0113-4d3f-be7c-425887d54c7b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:57.812607 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d8d26a-0113-4d3f-be7c-425887d54c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:57.850581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:57.877869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30b90c-505e-420d-879b-460cba1fb043 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:57.878480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b90c-505e-420d-879b-460cba1fb043 service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:57.878754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b90c-505e-420d-879b-460cba1fb043 service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:57.879048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf30b90c-505e-420d-879b-460cba1fb043 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:57.880265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d9d8d26a-0113-4d3f-be7c-425887d54c7b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:58:57.880827 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-bf30b90c-505e-420d-879b-460cba1fb043 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:57.881660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d9d8d26a-0113-4d3f-be7c-425887d54c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:57.950071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:57.970918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30b90c-505e-420d-879b-460cba1fb043 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:57.972531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf30b90c-505e-420d-879b-460cba1fb043 service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:57.981010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 702/1401] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 20:58:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 20:58:57.986072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 700/1402] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:58:58.279384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30b90c-505e-420d-879b-460cba1fb043 service swift] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:58:58.280602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-bf30b90c-505e-420d-879b-460cba1fb043 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:58.384856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf30b90c-505e-420d-879b-460cba1fb043 service swift] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:58:58.507295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:58:58.513405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14ad19-cf19-4935-9ac2-d59ac3ca7c98 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:58:58.514028 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14ad19-cf19-4935-9ac2-d59ac3ca7c98 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:58:58.514298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14ad19-cf19-4935-9ac2-d59ac3ca7c98 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:58:58.514569 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14ad19-cf19-4935-9ac2-d59ac3ca7c98 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:58:58.516845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ec14ad19-cf19-4935-9ac2-d59ac3ca7c98 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:58:58.624445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14ad19-cf19-4935-9ac2-d59ac3ca7c98 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:58:58.625974 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14ad19-cf19-4935-9ac2-d59ac3ca7c98 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:58:58.645584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 703/1403] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:00.598737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0911d-80ab-4760-b8bd-50097faf057a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.599393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0911d-80ab-4760-b8bd-50097faf057a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.599680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0911d-80ab-4760-b8bd-50097faf057a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.605755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 701/1404] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:59:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:00.606415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1eaa-fffb-4f87-bf33-5e14654a184a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:00.606870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1eaa-fffb-4f87-bf33-5e14654a184a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:00.607003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3b1eaa-fffb-4f87-bf33-5e14654a184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:00.688164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-fe3b1eaa-fffb-4f87-bf33-5e14654a184a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:00.689492 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-fe3b1eaa-fffb-4f87-bf33-5e14654a184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:00.768530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:00.804758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 704/1405] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:59:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 20:59:01.091397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0911d-80ab-4760-b8bd-50097faf057a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:01.093147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bed0911d-80ab-4760-b8bd-50097faf057a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:01.224617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:01.279675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0911d-80ab-4760-b8bd-50097faf057a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:01.409476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc73e10-f555-4f90-9165-3c6ae88e652f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:01.410591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73e10-f555-4f90-9165-3c6ae88e652f service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:01.410987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73e10-f555-4f90-9165-3c6ae88e652f service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:01.411350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc73e10-f555-4f90-9165-3c6ae88e652f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:01.413115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4dc73e10-f555-4f90-9165-3c6ae88e652f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:01.494010 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:01.523130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc73e10-f555-4f90-9165-3c6ae88e652f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:01.525336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc73e10-f555-4f90-9165-3c6ae88e652f service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:01.547692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 702/1406] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:03.547466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c0f05-b2be-43e0-85ca-e4b73f0a78a5 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:03.548083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c0f05-b2be-43e0-85ca-e4b73f0a78a5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:03.548083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3c0f05-b2be-43e0-85ca-e4b73f0a78a5 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:03.549361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 705/1407] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 20:59:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:03.554737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5551b-e59e-4157-845e-f58ca8f371c0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:03.555216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5551b-e59e-4157-845e-f58ca8f371c0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:03.555437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5551b-e59e-4157-845e-f58ca8f371c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:03.633805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1fd5551b-e59e-4157-845e-f58ca8f371c0 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:03.635068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1fd5551b-e59e-4157-845e-f58ca8f371c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:03.737942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 703/1408] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 20:59:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:04.022477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c0f05-b2be-43e0-85ca-e4b73f0a78a5 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:04.026218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7a3c0f05-b2be-43e0-85ca-e4b73f0a78a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:04.190806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3c0f05-b2be-43e0-85ca-e4b73f0a78a5 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:04.257105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:04.353317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c6e99e-2c59-4929-a84e-34f252fbd6b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:04.353913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6e99e-2c59-4929-a84e-34f252fbd6b5 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:04.354194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6e99e-2c59-4929-a84e-34f252fbd6b5 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:04.354460 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c6e99e-2c59-4929-a84e-34f252fbd6b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:04.356278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-38c6e99e-2c59-4929-a84e-34f252fbd6b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:04.454972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6e99e-2c59-4929-a84e-34f252fbd6b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:04.456526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c6e99e-2c59-4929-a84e-34f252fbd6b5 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:04.477070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 706/1409] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:13.736057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=79 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:14.474802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=74 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:19.979242 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0508-9547-4c71-8397-1f00e140b10d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:19.979841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0508-9547-4c71-8397-1f00e140b10d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:19.979841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797d0508-9547-4c71-8397-1f00e140b10d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:19.981173 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 704/1410] 10.222.0.59 () {54 vars in 918 bytes} [Thu Aug 18 20:59:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:19.988620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9765fd-c087-4c29-8325-eb1ae29c2cd3 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:19.989012 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9765fd-c087-4c29-8325-eb1ae29c2cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:19.989164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9765fd-c087-4c29-8325-eb1ae29c2cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:20.074271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-5a9765fd-c087-4c29-8325-eb1ae29c2cd3 None None] MFA Rules not processed for user `16a4ba52fe124009a570fd1408903cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:20.075455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5a9765fd-c087-4c29-8325-eb1ae29c2cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:20.197683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 707/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Aug 18 20:59:19 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:20.215410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c1908-ae1f-40aa-937d-b1ddba052a62 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:20.215694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c1908-ae1f-40aa-937d-b1ddba052a62 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:20.215963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79c1908-ae1f-40aa-937d-b1ddba052a62 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:20.217318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 705/1412] 10.222.0.59 () {54 vars in 918 bytes} [Thu Aug 18 20:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:20.222304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab811-8397-4da1-ace2-95d51a3b16f8 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:20.222587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab811-8397-4da1-ace2-95d51a3b16f8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:20.222894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0ab811-8397-4da1-ace2-95d51a3b16f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:20.313579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:20.316980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-2c0ab811-8397-4da1-ace2-95d51a3b16f8 None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:20.319010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2c0ab811-8397-4da1-ace2-95d51a3b16f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:20.445386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 708/1413] 10.222.0.59 () {58 vars in 1015 bytes} [Thu Aug 18 20:59:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:22.942286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101196-d785-4363-9b10-e93f0b54ed19 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:22.943483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101196-d785-4363-9b10-e93f0b54ed19 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:22.943483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a101196-d785-4363-9b10-e93f0b54ed19 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:22.945222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 706/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:59:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:22.950695 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4fca-b00f-4817-9907-76f32c97b0f2 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:22.951164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4fca-b00f-4817-9907-76f32c97b0f2 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:22.951268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ff4fca-b00f-4817-9907-76f32c97b0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:23.034504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-66ff4fca-b00f-4817-9907-76f32c97b0f2 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:23.035700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-66ff4fca-b00f-4817-9907-76f32c97b0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:23.093325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:23.135852 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 709/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:59:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:23.444276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a101196-d785-4363-9b10-e93f0b54ed19 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:23.446087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6a101196-d785-4363-9b10-e93f0b54ed19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:23.608826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a101196-d785-4363-9b10-e93f0b54ed19 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:23.686995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:23.732235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd55ac1-d6d5-4421-ac01-6c755d1c9ab1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:23.732847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55ac1-d6d5-4421-ac01-6c755d1c9ab1 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:23.733122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55ac1-d6d5-4421-ac01-6c755d1c9ab1 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:23.733398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd55ac1-d6d5-4421-ac01-6c755d1c9ab1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:23.735071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dbd55ac1-d6d5-4421-ac01-6c755d1c9ab1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:23.833093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd55ac1-d6d5-4421-ac01-6c755d1c9ab1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:23.834939 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd55ac1-d6d5-4421-ac01-6c755d1c9ab1 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:23.854553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 707/1416] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:24.797384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766dd5-c018-447b-b614-cb8b6ed7cb87 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:24.797888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766dd5-c018-447b-b614-cb8b6ed7cb87 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:24.797888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766dd5-c018-447b-b614-cb8b6ed7cb87 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:24.799355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 710/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:59:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:24.804715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228ad93-7362-4f03-9c9e-2230ef7adad4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:24.805166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228ad93-7362-4f03-9c9e-2230ef7adad4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:24.805263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8228ad93-7362-4f03-9c9e-2230ef7adad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:24.889529 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8228ad93-7362-4f03-9c9e-2230ef7adad4 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:24.890816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8228ad93-7362-4f03-9c9e-2230ef7adad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:24.920547 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:25.006081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 708/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:25.160738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44766dd5-c018-447b-b614-cb8b6ed7cb87 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:25.162248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-44766dd5-c018-447b-b614-cb8b6ed7cb87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:25.316494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44766dd5-c018-447b-b614-cb8b6ed7cb87 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:25.366636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:25.447513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef2d1d7-0cbd-404b-9aed-df371f78ad23 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:25.448037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2d1d7-0cbd-404b-9aed-df371f78ad23 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:25.448310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2d1d7-0cbd-404b-9aed-df371f78ad23 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:25.448573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef2d1d7-0cbd-404b-9aed-df371f78ad23 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:25.450157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2ef2d1d7-0cbd-404b-9aed-df371f78ad23 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:25.551313 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2d1d7-0cbd-404b-9aed-df371f78ad23 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:25.553081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef2d1d7-0cbd-404b-9aed-df371f78ad23 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:25.571278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 711/1419] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:26.469746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1ff8b-d6ba-4b1d-a366-3527df69d4b5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:26.470656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1ff8b-d6ba-4b1d-a366-3527df69d4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:26.470656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c1ff8b-d6ba-4b1d-a366-3527df69d4b5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:26.472817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 709/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:59:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:26.482387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678cd30-591d-4993-b05a-ed5b7898bb84 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:26.482891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678cd30-591d-4993-b05a-ed5b7898bb84 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:26.482988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678cd30-591d-4993-b05a-ed5b7898bb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:26.544266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:26.567463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7678cd30-591d-4993-b05a-ed5b7898bb84 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:26.568791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7678cd30-591d-4993-b05a-ed5b7898bb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:26.684996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 712/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:59:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:26.851453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1ff8b-d6ba-4b1d-a366-3527df69d4b5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:26.853067 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c3c1ff8b-d6ba-4b1d-a366-3527df69d4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:27.006681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c1ff8b-d6ba-4b1d-a366-3527df69d4b5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:27.020628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:27.143953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71350484-1498-4fdf-986e-13e95bec09ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:27.144910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350484-1498-4fdf-986e-13e95bec09ad service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:27.145185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350484-1498-4fdf-986e-13e95bec09ad service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:27.145449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71350484-1498-4fdf-986e-13e95bec09ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:27.147308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-71350484-1498-4fdf-986e-13e95bec09ad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:27.259508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71350484-1498-4fdf-986e-13e95bec09ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:27.261225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71350484-1498-4fdf-986e-13e95bec09ad service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:27.282139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 710/1422] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:28.154759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7f20d-f461-4b87-a2c8-154b1067a36e None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:28.155660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7f20d-f461-4b87-a2c8-154b1067a36e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:28.155660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7f20d-f461-4b87-a2c8-154b1067a36e None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:28.157773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 713/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:59:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:28.163254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3605abf-8416-4ede-93da-c9a9d0642961 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:28.163678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3605abf-8416-4ede-93da-c9a9d0642961 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:28.163791 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3605abf-8416-4ede-93da-c9a9d0642961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:28.185452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:28.251189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e3605abf-8416-4ede-93da-c9a9d0642961 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:28.252423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e3605abf-8416-4ede-93da-c9a9d0642961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:28.357126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 711/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:59:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:28.520110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7f20d-f461-4b87-a2c8-154b1067a36e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:28.522592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-07b7f20d-f461-4b87-a2c8-154b1067a36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:28.645204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:28.693687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7f20d-f461-4b87-a2c8-154b1067a36e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:28.811874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78534b0a-2680-406c-bd31-fbf91bd0ee9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:28.812485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78534b0a-2680-406c-bd31-fbf91bd0ee9d service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:28.812758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78534b0a-2680-406c-bd31-fbf91bd0ee9d service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:28.813023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78534b0a-2680-406c-bd31-fbf91bd0ee9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:28.814612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-78534b0a-2680-406c-bd31-fbf91bd0ee9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:28.892547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:28.910045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78534b0a-2680-406c-bd31-fbf91bd0ee9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:28.911705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78534b0a-2680-406c-bd31-fbf91bd0ee9d service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:28.933637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 714/1425] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:29.797120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08aa32-27c5-4337-89a7-eea58fa6de7c None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:29.797642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08aa32-27c5-4337-89a7-eea58fa6de7c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:29.797642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be08aa32-27c5-4337-89a7-eea58fa6de7c None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:29.799075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 712/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:59:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:29.804902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bcb92-514b-4588-aa46-b3a4e71e9e76 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:29.805380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bcb92-514b-4588-aa46-b3a4e71e9e76 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:29.805511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52bcb92-514b-4588-aa46-b3a4e71e9e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:29.888608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d52bcb92-514b-4588-aa46-b3a4e71e9e76 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:29.889833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d52bcb92-514b-4588-aa46-b3a4e71e9e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:30.011561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 715/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:30.169996 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08aa32-27c5-4337-89a7-eea58fa6de7c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:30.172422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-be08aa32-27c5-4337-89a7-eea58fa6de7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:30.283527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:30.345842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be08aa32-27c5-4337-89a7-eea58fa6de7c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:30.471350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9530a19-99f5-4cf8-9a5a-31b35424f056 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:30.471863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9530a19-99f5-4cf8-9a5a-31b35424f056 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:30.472138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9530a19-99f5-4cf8-9a5a-31b35424f056 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:30.472404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9530a19-99f5-4cf8-9a5a-31b35424f056 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:30.474041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b9530a19-99f5-4cf8-9a5a-31b35424f056 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:30.523713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:30.568261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9530a19-99f5-4cf8-9a5a-31b35424f056 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:30.569984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9530a19-99f5-4cf8-9a5a-31b35424f056 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:30.588426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 713/1428] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:31.406659 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2e32f-fef6-4b85-ab99-eb2cae68a3fb None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:31.407293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2e32f-fef6-4b85-ab99-eb2cae68a3fb None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:31.407293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a2e32f-fef6-4b85-ab99-eb2cae68a3fb None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:31.408609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 716/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:59:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:31.414243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601cff2-1964-4b8d-86c7-e89c0dacd815 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:31.414709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601cff2-1964-4b8d-86c7-e89c0dacd815 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:31.414836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601cff2-1964-4b8d-86c7-e89c0dacd815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:31.501090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4601cff2-1964-4b8d-86c7-e89c0dacd815 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:31.502299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4601cff2-1964-4b8d-86c7-e89c0dacd815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:31.607782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 714/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:31.762273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2e32f-fef6-4b85-ab99-eb2cae68a3fb None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:31.764781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f6a2e32f-fef6-4b85-ab99-eb2cae68a3fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:31.819548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:31.925408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a2e32f-fef6-4b85-ab99-eb2cae68a3fb None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:32.057316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea9acde-6a68-4bab-b173-8cbb5c9f4e5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:32.057857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9acde-6a68-4bab-b173-8cbb5c9f4e5a service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:32.058130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9acde-6a68-4bab-b173-8cbb5c9f4e5a service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:32.058397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea9acde-6a68-4bab-b173-8cbb5c9f4e5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:32.060022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-eea9acde-6a68-4bab-b173-8cbb5c9f4e5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:32.067344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:32.155243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9acde-6a68-4bab-b173-8cbb5c9f4e5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:32.156846 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea9acde-6a68-4bab-b173-8cbb5c9f4e5a service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:32.181762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 717/1431] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:32.990017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a33f-52d5-4afc-b6f0-7cb811265967 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:32.991146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a33f-52d5-4afc-b6f0-7cb811265967 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:32.991146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9301a33f-52d5-4afc-b6f0-7cb811265967 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:32.992003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 715/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 20:59:32.998109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075068-c4e9-4530-883a-8025654c9475 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:32.998587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075068-c4e9-4530-883a-8025654c9475 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:32.998713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8075068-c4e9-4530-883a-8025654c9475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:33.080433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-b8075068-c4e9-4530-883a-8025654c9475 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:33.081647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b8075068-c4e9-4530-883a-8025654c9475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:33.156465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:33.195955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 718/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:59:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:33.353090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a33f-52d5-4afc-b6f0-7cb811265967 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:33.354522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9301a33f-52d5-4afc-b6f0-7cb811265967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:33.373514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:33.516686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9301a33f-52d5-4afc-b6f0-7cb811265967 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:33.608063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:33.636202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a3d978-ff1c-4afc-a74f-dfcd8f61a9d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:33.636807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d978-ff1c-4afc-a74f-dfcd8f61a9d3 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:33.637084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d978-ff1c-4afc-a74f-dfcd8f61a9d3 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:33.637354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a3d978-ff1c-4afc-a74f-dfcd8f61a9d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:33.638996 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-13a3d978-ff1c-4afc-a74f-dfcd8f61a9d3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:33.734027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3d978-ff1c-4afc-a74f-dfcd8f61a9d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:33.735703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a3d978-ff1c-4afc-a74f-dfcd8f61a9d3 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:33.754965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 716/1434] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:34.556583 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5782643-ba14-402c-9933-1a0a39278187 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:34.557504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5782643-ba14-402c-9933-1a0a39278187 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:34.557504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5782643-ba14-402c-9933-1a0a39278187 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:34.559746 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 719/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:59:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:34.564942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7805393-49de-4bbd-88de-7796b0ac0d18 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:34.565376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7805393-49de-4bbd-88de-7796b0ac0d18 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:34.565486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7805393-49de-4bbd-88de-7796b0ac0d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:34.642866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c7805393-49de-4bbd-88de-7796b0ac0d18 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:34.644426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c7805393-49de-4bbd-88de-7796b0ac0d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:34.691383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:34.753975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 717/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:34.929304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5782643-ba14-402c-9933-1a0a39278187 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:34.930739 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e5782643-ba14-402c-9933-1a0a39278187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:35.094764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5782643-ba14-402c-9933-1a0a39278187 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:35.156837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:35.218164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be600b8-e0f5-46af-920f-5eb0a47bd424 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:35.218683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be600b8-e0f5-46af-920f-5eb0a47bd424 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:35.218992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be600b8-e0f5-46af-920f-5eb0a47bd424 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:35.219260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be600b8-e0f5-46af-920f-5eb0a47bd424 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:35.220861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3be600b8-e0f5-46af-920f-5eb0a47bd424 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:35.317058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be600b8-e0f5-46af-920f-5eb0a47bd424 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:35.318729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3be600b8-e0f5-46af-920f-5eb0a47bd424 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:35.338544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 720/1437] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:36.133904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647d5e-589a-4e39-9667-9341185aacc5 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:36.134759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647d5e-589a-4e39-9667-9341185aacc5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:36.134759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09647d5e-589a-4e39-9667-9341185aacc5 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:36.136893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 718/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 20:59:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:36.142875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f985685-704e-412f-a905-b2500d56c2d8 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:36.143329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f985685-704e-412f-a905-b2500d56c2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:36.143446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f985685-704e-412f-a905-b2500d56c2d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:36.233124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-2f985685-704e-412f-a905-b2500d56c2d8 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:36.234335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2f985685-704e-412f-a905-b2500d56c2d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:36.236496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:36.342593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 721/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 20:59:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:36.508147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09647d5e-589a-4e39-9667-9341185aacc5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:36.509709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-09647d5e-589a-4e39-9667-9341185aacc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:36.676963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09647d5e-589a-4e39-9667-9341185aacc5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:36.704329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:36.806042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d53261-d5e9-46ef-b538-0fc12edb371b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:36.806683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d53261-d5e9-46ef-b538-0fc12edb371b service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:36.806996 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d53261-d5e9-46ef-b538-0fc12edb371b service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:36.807259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d53261-d5e9-46ef-b538-0fc12edb371b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:36.808842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-04d53261-d5e9-46ef-b538-0fc12edb371b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:36.907106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d53261-d5e9-46ef-b538-0fc12edb371b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:36.908736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d53261-d5e9-46ef-b538-0fc12edb371b service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:36.927178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 719/1440] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:38.733914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a591b0-80b0-4ca3-bf73-4b69e55997cd None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:38.734501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a591b0-80b0-4ca3-bf73-4b69e55997cd None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:38.734501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a591b0-80b0-4ca3-bf73-4b69e55997cd None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:38.735890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 722/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:38.741440 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfccc69-79b6-4829-a121-ff2e0ffac6b9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:38.741893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfccc69-79b6-4829-a121-ff2e0ffac6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:38.742078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfccc69-79b6-4829-a121-ff2e0ffac6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:38.792280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:38.823217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bcfccc69-79b6-4829-a121-ff2e0ffac6b9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:38.824445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bcfccc69-79b6-4829-a121-ff2e0ffac6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:38.945898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 720/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:39.262507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a591b0-80b0-4ca3-bf73-4b69e55997cd None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:39.264022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-90a591b0-80b0-4ca3-bf73-4b69e55997cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:39.405057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a591b0-80b0-4ca3-bf73-4b69e55997cd None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:39.453629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:39.504736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae14aae-0517-4e63-862c-2893c55b5bce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:39.505350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae14aae-0517-4e63-862c-2893c55b5bce service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:39.505653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae14aae-0517-4e63-862c-2893c55b5bce service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:39.506141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae14aae-0517-4e63-862c-2893c55b5bce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:39.507756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-bae14aae-0517-4e63-862c-2893c55b5bce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:39.652436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae14aae-0517-4e63-862c-2893c55b5bce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:39.654329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae14aae-0517-4e63-862c-2893c55b5bce service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:39.673494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 723/1443] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:41.736281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f8dd2-f9a7-4cc6-9d1e-35008be3b436 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:41.737148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f8dd2-f9a7-4cc6-9d1e-35008be3b436 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:41.737148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766f8dd2-f9a7-4cc6-9d1e-35008be3b436 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:41.739439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:59:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:41.749447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989661-695b-4fd0-834d-c1a2d39f3f09 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:41.749872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989661-695b-4fd0-834d-c1a2d39f3f09 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:41.750070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42989661-695b-4fd0-834d-c1a2d39f3f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:41.822847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-42989661-695b-4fd0-834d-c1a2d39f3f09 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:41.824117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-42989661-695b-4fd0-834d-c1a2d39f3f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:41.837407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:41.929660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:59:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:42.212669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f8dd2-f9a7-4cc6-9d1e-35008be3b436 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:42.214201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-766f8dd2-f9a7-4cc6-9d1e-35008be3b436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:42.347619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766f8dd2-f9a7-4cc6-9d1e-35008be3b436 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:42.360592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:42.428119 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f9d28-3be5-4b7b-b30a-5873efc4f4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:42.428726 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f9d28-3be5-4b7b-b30a-5873efc4f4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:42.429001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f9d28-3be5-4b7b-b30a-5873efc4f4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:42.429269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f9d28-3be5-4b7b-b30a-5873efc4f4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:42.430944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b18f9d28-3be5-4b7b-b30a-5873efc4f4c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:42.566034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f9d28-3be5-4b7b-b30a-5873efc4f4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:42.568294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f9d28-3be5-4b7b-b30a-5873efc4f4c9 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:42.587937 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 722/1446] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:44.817071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e35ae7-6227-4bca-b004-b0cd43692811 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:44.817592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e35ae7-6227-4bca-b004-b0cd43692811 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:44.817592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e35ae7-6227-4bca-b004-b0cd43692811 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:44.819058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:59:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:44.824650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199d528-269e-455e-a57e-28fd00f584fe None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:44.825100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199d528-269e-455e-a57e-28fd00f584fe None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:44.825205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199d528-269e-455e-a57e-28fd00f584fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:44.885636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:44.905611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0199d528-269e-455e-a57e-28fd00f584fe None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:44.906911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0199d528-269e-455e-a57e-28fd00f584fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:45.007989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:59:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:45.300181 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e35ae7-6227-4bca-b004-b0cd43692811 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:45.309437 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-28e35ae7-6227-4bca-b004-b0cd43692811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:45.427276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e35ae7-6227-4bca-b004-b0cd43692811 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:45.477141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:45.516666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcbaddb-fcbe-444a-a19b-ec09b521fdd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:45.517284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbaddb-fcbe-444a-a19b-ec09b521fdd7 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:45.517559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbaddb-fcbe-444a-a19b-ec09b521fdd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:45.517825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcbaddb-fcbe-444a-a19b-ec09b521fdd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:45.519808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6bcbaddb-fcbe-444a-a19b-ec09b521fdd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:45.648540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbaddb-fcbe-444a-a19b-ec09b521fdd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:45.650550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcbaddb-fcbe-444a-a19b-ec09b521fdd7 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:45.674241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 726/1449] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:47.730379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630312-4b33-46b8-b1a7-f9ca1d729107 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:47.730991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630312-4b33-46b8-b1a7-f9ca1d729107 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:47.730991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d630312-4b33-46b8-b1a7-f9ca1d729107 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:47.732331 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:59:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:47.737833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce981f-4b27-41fd-92a3-8bd6778d8336 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:47.738273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce981f-4b27-41fd-92a3-8bd6778d8336 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:47.738369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ce981f-4b27-41fd-92a3-8bd6778d8336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:47.808000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d8ce981f-4b27-41fd-92a3-8bd6778d8336 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:47.809211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d8ce981f-4b27-41fd-92a3-8bd6778d8336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:47.841002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:47.926327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:59:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:48.208474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630312-4b33-46b8-b1a7-f9ca1d729107 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:48.210356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1d630312-4b33-46b8-b1a7-f9ca1d729107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:48.326927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d630312-4b33-46b8-b1a7-f9ca1d729107 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:48.353397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:48.413701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef10bf5e-dbaa-405d-8d6e-24096b10a924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:48.414304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10bf5e-dbaa-405d-8d6e-24096b10a924 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:48.414580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10bf5e-dbaa-405d-8d6e-24096b10a924 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:48.414877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef10bf5e-dbaa-405d-8d6e-24096b10a924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:48.416494 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef10bf5e-dbaa-405d-8d6e-24096b10a924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:48.553511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10bf5e-dbaa-405d-8d6e-24096b10a924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:48.554998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef10bf5e-dbaa-405d-8d6e-24096b10a924 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:48.574554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 725/1452] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:50.550166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362746f-6f17-44d5-a6d2-407301dfcd4d None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:50.551579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362746f-6f17-44d5-a6d2-407301dfcd4d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:50.551579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4362746f-6f17-44d5-a6d2-407301dfcd4d None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:50.553123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:50.559233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d436d-9266-4b8f-88b7-3abd677b27ba None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:50.559682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d436d-9266-4b8f-88b7-3abd677b27ba None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:50.559795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56d436d-9266-4b8f-88b7-3abd677b27ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:50.626529 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:50.629418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b56d436d-9266-4b8f-88b7-3abd677b27ba None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:50.631567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b56d436d-9266-4b8f-88b7-3abd677b27ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:50.758807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:51.045114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362746f-6f17-44d5-a6d2-407301dfcd4d None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:51.047665 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4362746f-6f17-44d5-a6d2-407301dfcd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:51.168611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4362746f-6f17-44d5-a6d2-407301dfcd4d None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:51.224546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:51.251706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900a950f-4feb-4efc-ac85-e3f42d857cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:51.252325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a950f-4feb-4efc-ac85-e3f42d857cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:51.252602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a950f-4feb-4efc-ac85-e3f42d857cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:51.252871 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900a950f-4feb-4efc-ac85-e3f42d857cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:51.254710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-900a950f-4feb-4efc-ac85-e3f42d857cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:51.380796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a950f-4feb-4efc-ac85-e3f42d857cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:51.382726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900a950f-4feb-4efc-ac85-e3f42d857cf2 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:51.402301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 729/1455] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:53.381544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba9810-1e8e-4140-8ac1-fb80271ad281 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:53.382401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba9810-1e8e-4140-8ac1-fb80271ad281 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:53.382500 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ba9810-1e8e-4140-8ac1-fb80271ad281 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:53.384751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:59:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:53.393580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f630f9c-70ce-4d27-8f41-8bb416bd583b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:53.394687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f630f9c-70ce-4d27-8f41-8bb416bd583b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:53.395017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f630f9c-70ce-4d27-8f41-8bb416bd583b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:53.474451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-6f630f9c-70ce-4d27-8f41-8bb416bd583b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:53.475902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6f630f9c-70ce-4d27-8f41-8bb416bd583b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:53.506157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:53.577770 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:53.881892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba9810-1e8e-4140-8ac1-fb80271ad281 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:53.883467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-40ba9810-1e8e-4140-8ac1-fb80271ad281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:53.993092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ba9810-1e8e-4140-8ac1-fb80271ad281 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:54.023409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:54.072336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c555ac-59d5-4380-9d18-0855926c61f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:54.072855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c555ac-59d5-4380-9d18-0855926c61f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:54.073126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c555ac-59d5-4380-9d18-0855926c61f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:54.073398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c555ac-59d5-4380-9d18-0855926c61f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:54.075172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-83c555ac-59d5-4380-9d18-0855926c61f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:54.195131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c555ac-59d5-4380-9d18-0855926c61f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:54.196602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c555ac-59d5-4380-9d18-0855926c61f4 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:54.214749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 728/1458] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:56.190963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3beea-c654-48ab-80ce-93220939dc58 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:56.191794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3beea-c654-48ab-80ce-93220939dc58 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:56.191794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef3beea-c654-48ab-80ce-93220939dc58 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:56.194423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:59:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:56.200047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d66ac-fb7a-48a0-ae3a-f23249e00abc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:56.200496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d66ac-fb7a-48a0-ae3a-f23249e00abc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:56.200605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73d66ac-fb7a-48a0-ae3a-f23249e00abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:56.276120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c73d66ac-fb7a-48a0-ae3a-f23249e00abc None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:56.277310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c73d66ac-fb7a-48a0-ae3a-f23249e00abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:56.286280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:56.387604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:59:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:56.676220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3beea-c654-48ab-80ce-93220939dc58 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:56.678723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3ef3beea-c654-48ab-80ce-93220939dc58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:56.797150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef3beea-c654-48ab-80ce-93220939dc58 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:56.855524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:56.875112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a80409-af8f-45fb-8d3f-759ae010b592 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:56.875725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a80409-af8f-45fb-8d3f-759ae010b592 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:56.875998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a80409-af8f-45fb-8d3f-759ae010b592 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:56.876264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a80409-af8f-45fb-8d3f-759ae010b592 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:56.877892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e3a80409-af8f-45fb-8d3f-759ae010b592 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:57.007782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a80409-af8f-45fb-8d3f-759ae010b592 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:57.009255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a80409-af8f-45fb-8d3f-759ae010b592 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:57.029417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 732/1461] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 20:59:58.964857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb931e-b03a-43c8-9648-598859caae0d None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:58.965720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb931e-b03a-43c8-9648-598859caae0d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:58.965720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb931e-b03a-43c8-9648-598859caae0d None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:58.968213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 20:59:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 20:59:58.974574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5694d7-3057-4ce7-96ab-6cf4be3d0b37 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:58.975709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5694d7-3057-4ce7-96ab-6cf4be3d0b37 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:58.975709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5694d7-3057-4ce7-96ab-6cf4be3d0b37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:59.048327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7a5694d7-3057-4ce7-96ab-6cf4be3d0b37 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 20:59:59.049550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7a5694d7-3057-4ce7-96ab-6cf4be3d0b37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:59.093714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:59.160000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 20:59:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 20:59:59.446177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb931e-b03a-43c8-9648-598859caae0d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 20:59:59.448679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3ceb931e-b03a-43c8-9648-598859caae0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:59.576469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb931e-b03a-43c8-9648-598859caae0d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 20:59:59.619772 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 20:59:59.661416 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02602c2-7896-4f08-8d4e-e9650dc1c938 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 20:59:59.662019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02602c2-7896-4f08-8d4e-e9650dc1c938 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 20:59:59.662694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02602c2-7896-4f08-8d4e-e9650dc1c938 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 20:59:59.663173 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02602c2-7896-4f08-8d4e-e9650dc1c938 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 20:59:59.664844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c02602c2-7896-4f08-8d4e-e9650dc1c938 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 20:59:59.926259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02602c2-7896-4f08-8d4e-e9650dc1c938 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 20:59:59.927863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02602c2-7896-4f08-8d4e-e9650dc1c938 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 20:59:59.947437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 731/1464] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 20:59:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:01.995236 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688c007-9112-4b71-9fbe-597e514e92ff None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:01.996170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688c007-9112-4b71-9fbe-597e514e92ff None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:01.996170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0688c007-9112-4b71-9fbe-597e514e92ff None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:01.998343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:00:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:02.004825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb191f-758b-49ae-bf0d-12a8166df93b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:02.005524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb191f-758b-49ae-bf0d-12a8166df93b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:02.005633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecdb191f-758b-49ae-bf0d-12a8166df93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:02.077622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ecdb191f-758b-49ae-bf0d-12a8166df93b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:02.078805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ecdb191f-758b-49ae-bf0d-12a8166df93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:02.098937 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:02.183231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:00:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:02.469604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688c007-9112-4b71-9fbe-597e514e92ff None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:02.471199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0688c007-9112-4b71-9fbe-597e514e92ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:02.584211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0688c007-9112-4b71-9fbe-597e514e92ff None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:02.655053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:02.663140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772d042c-5923-4e20-b6f7-4e86f3dc867f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:02.664444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d042c-5923-4e20-b6f7-4e86f3dc867f service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:02.664911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d042c-5923-4e20-b6f7-4e86f3dc867f service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:02.665327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772d042c-5923-4e20-b6f7-4e86f3dc867f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:02.667323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-772d042c-5923-4e20-b6f7-4e86f3dc867f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:02.792841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d042c-5923-4e20-b6f7-4e86f3dc867f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:02.794328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772d042c-5923-4e20-b6f7-4e86f3dc867f service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:02.821416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 735/1467] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:00:04.748159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce152d-c0f9-4eb8-abd4-6d270e353799 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:04.748911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce152d-c0f9-4eb8-abd4-6d270e353799 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:04.748911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ce152d-c0f9-4eb8-abd4-6d270e353799 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:04.750055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:00:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:04.756553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dca60-52b0-4c70-9d60-b582b9c57af6 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:04.757427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dca60-52b0-4c70-9d60-b582b9c57af6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:04.757427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422dca60-52b0-4c70-9d60-b582b9c57af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:04.842522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-422dca60-52b0-4c70-9d60-b582b9c57af6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:04.844330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-422dca60-52b0-4c70-9d60-b582b9c57af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:04.905923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:04.958278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:00:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:05.242342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce152d-c0f9-4eb8-abd4-6d270e353799 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:05.243916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a7ce152d-c0f9-4eb8-abd4-6d270e353799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:05.369281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ce152d-c0f9-4eb8-abd4-6d270e353799 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:05.419099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:05.448266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02724782-abb1-46cb-8423-35554ad7e0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:05.448873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02724782-abb1-46cb-8423-35554ad7e0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:05.449150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02724782-abb1-46cb-8423-35554ad7e0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:05.449418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02724782-abb1-46cb-8423-35554ad7e0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:05.451069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-02724782-abb1-46cb-8423-35554ad7e0c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:05.572650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02724782-abb1-46cb-8423-35554ad7e0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:05.574005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02724782-abb1-46cb-8423-35554ad7e0c6 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:05.595266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 734/1470] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:00:14.956300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=22 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:15.592724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=66 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:25.206051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387e3da-f35d-4fa5-84d0-f2a6045e09f0 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:25.206643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387e3da-f35d-4fa5-84d0-f2a6045e09f0 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:25.206643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387e3da-f35d-4fa5-84d0-f2a6045e09f0 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:25.208010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 737/1471] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 21:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:25.214367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d4a0a-2af6-4f40-8896-2bf5f953610a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:25.215337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d4a0a-2af6-4f40-8896-2bf5f953610a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:25.215337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76d4a0a-2af6-4f40-8896-2bf5f953610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:25.290330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d76d4a0a-2af6-4f40-8896-2bf5f953610a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:25.292171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d76d4a0a-2af6-4f40-8896-2bf5f953610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:25.392440 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 735/1472] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:25.690172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ea5df-fd26-4e39-9fab-e0ab83eb3262 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:25.690454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ea5df-fd26-4e39-9fab-e0ab83eb3262 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:25.690726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4ea5df-fd26-4e39-9fab-e0ab83eb3262 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:25.692203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 738/1473] 10.222.0.59 () {54 vars in 967 bytes} [Thu Aug 18 21:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:25.697956 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c44a68-b3a4-4b59-af7a-def5ad92ec6f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:25.698269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c44a68-b3a4-4b59-af7a-def5ad92ec6f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:25.698537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c44a68-b3a4-4b59-af7a-def5ad92ec6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:25.783400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-26c44a68-b3a4-4b59-af7a-def5ad92ec6f None None] MFA Rules not processed for user `7074acac73904bab8399f223bd662863`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:25.784612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-26c44a68-b3a4-4b59-af7a-def5ad92ec6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:25.806434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:25.865204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 736/1474] 10.222.0.59 () {58 vars in 1064 bytes} [Thu Aug 18 21:00:25 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:25.873701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ea5df-fd26-4e39-9fab-e0ab83eb3262 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:25.875991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2e4ea5df-fd26-4e39-9fab-e0ab83eb3262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:26.002669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4ea5df-fd26-4e39-9fab-e0ab83eb3262 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:26.089565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd86c87-7fcc-475b-bc92-84a023373cda service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7074acac73904bab8399f223bd662863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:26.090171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd86c87-7fcc-475b-bc92-84a023373cda service glance] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:26.090422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd86c87-7fcc-475b-bc92-84a023373cda service glance] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:26.090691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd86c87-7fcc-475b-bc92-84a023373cda service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:26.092335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3cd86c87-7fcc-475b-bc92-84a023373cda service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:26.151466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:26.212593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd86c87-7fcc-475b-bc92-84a023373cda service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:26.214114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd86c87-7fcc-475b-bc92-84a023373cda service glance] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:26.233377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 739/1475] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:28.240654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78496af-c3e7-40d6-8176-a7882442e86f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.241209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78496af-c3e7-40d6-8176-a7882442e86f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.241209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78496af-c3e7-40d6-8176-a7882442e86f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.242570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 737/1476] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 21:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:28.249157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54f22d-e244-48a2-bf74-f910c0e6d285 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.249940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54f22d-e244-48a2-bf74-f910c0e6d285 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.250090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd54f22d-e244-48a2-bf74-f910c0e6d285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.335999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-bd54f22d-e244-48a2-bf74-f910c0e6d285 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:28.337801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-bd54f22d-e244-48a2-bf74-f910c0e6d285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:28.461342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 740/1477] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:28.731178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78496af-c3e7-40d6-8176-a7882442e86f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:28.732730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a78496af-c3e7-40d6-8176-a7882442e86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:28.871987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78496af-c3e7-40d6-8176-a7882442e86f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:28.924212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:28.971891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a005d7cd-1ca7-4494-b42b-68276268b4c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:28.972503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005d7cd-1ca7-4494-b42b-68276268b4c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:28.972778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005d7cd-1ca7-4494-b42b-68276268b4c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:28.973135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a005d7cd-1ca7-4494-b42b-68276268b4c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:28.973780 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005d7cd-1ca7-4494-b42b-68276268b4c6 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:28.975598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WARNING py.warnings [None req-a005d7cd-1ca7-4494-b42b-68276268b4c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:00:28.975598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: warnings.warn(msg) Aug 18 21:00:28.975598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: Aug 18 21:00:28.976740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a005d7cd-1ca7-4494-b42b-68276268b4c6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:28.996128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 738/1478] 10.222.0.59 () {56 vars in 1108 bytes} [Thu Aug 18 21:00:28 2022] GET /identity/v3/projects => generated 2553 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:00:30.932761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7edd9c-7268-4235-abf7-43c34be19d03 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.933326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7edd9c-7268-4235-abf7-43c34be19d03 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.933326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7edd9c-7268-4235-abf7-43c34be19d03 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:30.934684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 741/1479] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 21:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:30.941168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d05ced-d675-4295-aa7e-e338944efb38 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:30.941926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d05ced-d675-4295-aa7e-e338944efb38 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:30.942093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d05ced-d675-4295-aa7e-e338944efb38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:31.017506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-81d05ced-d675-4295-aa7e-e338944efb38 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:31.018733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-81d05ced-d675-4295-aa7e-e338944efb38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:31.129470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 739/1480] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:31.420407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7edd9c-7268-4235-abf7-43c34be19d03 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:31.421940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-eb7edd9c-7268-4235-abf7-43c34be19d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:31.432307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:31.578810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7edd9c-7268-4235-abf7-43c34be19d03 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:31.670124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:31.710399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b01127-ff9c-47dc-98f6-4a5dbc7b3ac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:31.711063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01127-ff9c-47dc-98f6-4a5dbc7b3ac1 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:31.711342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01127-ff9c-47dc-98f6-4a5dbc7b3ac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:31.711643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b01127-ff9c-47dc-98f6-4a5dbc7b3ac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:31.713245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d7b01127-ff9c-47dc-98f6-4a5dbc7b3ac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:31.811851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b01127-ff9c-47dc-98f6-4a5dbc7b3ac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:31.813462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b01127-ff9c-47dc-98f6-4a5dbc7b3ac1 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:31.837225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 742/1481] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:33.935147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1df89-d5b0-4e79-84e8-e4d66b16d420 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:33.936112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1df89-d5b0-4e79-84e8-e4d66b16d420 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:33.936112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a1df89-d5b0-4e79-84e8-e4d66b16d420 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:33.938325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 740/1482] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 21:00:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:33.944723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad485b-d0f6-4f4e-be0a-60805cb5ca79 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:33.945149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad485b-d0f6-4f4e-be0a-60805cb5ca79 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:33.945283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad485b-d0f6-4f4e-be0a-60805cb5ca79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.017765 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-52ad485b-d0f6-4f4e-be0a-60805cb5ca79 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:34.019088 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-52ad485b-d0f6-4f4e-be0a-60805cb5ca79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:34.070199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:34.134039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 743/1483] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:34.416622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1df89-d5b0-4e79-84e8-e4d66b16d420 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:34.419052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-78a1df89-d5b0-4e79-84e8-e4d66b16d420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:34.447006 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:34.533929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a1df89-d5b0-4e79-84e8-e4d66b16d420 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:34.630847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f036a61-465a-47ee-b269-00254d5e8309 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:34.631489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f036a61-465a-47ee-b269-00254d5e8309 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:34.631987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f036a61-465a-47ee-b269-00254d5e8309 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:34.632260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f036a61-465a-47ee-b269-00254d5e8309 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:34.633878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0f036a61-465a-47ee-b269-00254d5e8309 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:34.736128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:34.781123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f036a61-465a-47ee-b269-00254d5e8309 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:34.782578 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f036a61-465a-47ee-b269-00254d5e8309 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:34.803154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 741/1484] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:36.790294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83573ba1-506d-4561-a46f-11d23ff01996 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:36.790848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83573ba1-506d-4561-a46f-11d23ff01996 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:36.790848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83573ba1-506d-4561-a46f-11d23ff01996 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:36.792228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 744/1485] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 21:00:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:36.798115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27420-9458-4856-8c07-0b940fdd5cde None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:36.798533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27420-9458-4856-8c07-0b940fdd5cde None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:36.798836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d27420-9458-4856-8c07-0b940fdd5cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:36.871983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b4d27420-9458-4856-8c07-0b940fdd5cde None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:36.873217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b4d27420-9458-4856-8c07-0b940fdd5cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:36.982056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 742/1486] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:37.277438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83573ba1-506d-4561-a46f-11d23ff01996 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:37.279943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-83573ba1-506d-4561-a46f-11d23ff01996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:37.411901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83573ba1-506d-4561-a46f-11d23ff01996 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:37.492713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:37.494700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56573378-162a-4bc3-9f09-31b370bdb0af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:37.495371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56573378-162a-4bc3-9f09-31b370bdb0af service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:37.495700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56573378-162a-4bc3-9f09-31b370bdb0af service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:37.496013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56573378-162a-4bc3-9f09-31b370bdb0af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:37.498096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-56573378-162a-4bc3-9f09-31b370bdb0af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:37.615792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56573378-162a-4bc3-9f09-31b370bdb0af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:37.617558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56573378-162a-4bc3-9f09-31b370bdb0af service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:37.638902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 745/1487] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:39.877330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727e14-877c-4604-bbbf-1893174a169b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:39.877916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727e14-877c-4604-bbbf-1893174a169b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:39.877916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c727e14-877c-4604-bbbf-1893174a169b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:39.879281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 743/1488] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 21:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:00:39.885087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ddce-e1a9-45f4-ab38-af27e43f5092 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:39.885539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ddce-e1a9-45f4-ab38-af27e43f5092 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:39.885632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e1ddce-e1a9-45f4-ab38-af27e43f5092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:39.956541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-45e1ddce-e1a9-45f4-ab38-af27e43f5092 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:39.957752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-45e1ddce-e1a9-45f4-ab38-af27e43f5092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:40.014956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:40.070541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 746/1489] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:40.365208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c727e14-877c-4604-bbbf-1893174a169b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:40.367203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2c727e14-877c-4604-bbbf-1893174a169b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:40.406328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:40.480241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c727e14-877c-4604-bbbf-1893174a169b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:40.566016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4596395c-4283-482b-a967-ac42e7f109f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:40.566837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596395c-4283-482b-a967-ac42e7f109f0 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:40.567220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596395c-4283-482b-a967-ac42e7f109f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:40.567611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4596395c-4283-482b-a967-ac42e7f109f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:40.569827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4596395c-4283-482b-a967-ac42e7f109f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:40.658835 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:40.690164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596395c-4283-482b-a967-ac42e7f109f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:40.691662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4596395c-4283-482b-a967-ac42e7f109f0 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:40.712941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 744/1490] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:42.848666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c02b1-3f21-4a69-9ad1-cf983ed8d13e None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:42.849553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c02b1-3f21-4a69-9ad1-cf983ed8d13e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:42.849553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c02b1-3f21-4a69-9ad1-cf983ed8d13e None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:42.851441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 747/1491] 10.222.0.59 () {54 vars in 927 bytes} [Thu Aug 18 21:00:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:00:42.857679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331176ed-9bc2-4175-b1b0-9b811f2ab50f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:42.858134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331176ed-9bc2-4175-b1b0-9b811f2ab50f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:42.858243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331176ed-9bc2-4175-b1b0-9b811f2ab50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:42.931572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-331176ed-9bc2-4175-b1b0-9b811f2ab50f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:00:42.932783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-331176ed-9bc2-4175-b1b0-9b811f2ab50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:43.041478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 745/1492] 10.222.0.59 () {58 vars in 1024 bytes} [Thu Aug 18 21:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:00:43.335674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c02b1-3f21-4a69-9ad1-cf983ed8d13e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:00:43.337260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-dd9c02b1-3f21-4a69-9ad1-cf983ed8d13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:43.456609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c02b1-3f21-4a69-9ad1-cf983ed8d13e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:00:43.536049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2d679-9596-4991-a626-db8c59350040 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:00:43.536661 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d679-9596-4991-a626-db8c59350040 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:00:43.536932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d679-9596-4991-a626-db8c59350040 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:00:43.537194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2d679-9596-4991-a626-db8c59350040 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:00:43.538827 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-fed2d679-9596-4991-a626-db8c59350040 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:00:43.548376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:43.657639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2d679-9596-4991-a626-db8c59350040 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:00:43.659302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2d679-9596-4991-a626-db8c59350040 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:00:43.679663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 748/1493] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:00:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:00:53.039628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=82 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:00:53.677281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=50 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.011742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd5f92-6975-4dce-9fae-efb9cce7fdd4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.012713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd5f92-6975-4dce-9fae-efb9cce7fdd4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.012713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecd5f92-6975-4dce-9fae-efb9cce7fdd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.106058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fecd5f92-6975-4dce-9fae-efb9cce7fdd4 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:56.107212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fecd5f92-6975-4dce-9fae-efb9cce7fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:56.224747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 746/1494] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:56.233391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939ad36-9a38-4eed-9cab-e8f62bb6b64c None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.233904 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939ad36-9a38-4eed-9cab-e8f62bb6b64c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.233904 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939ad36-9a38-4eed-9cab-e8f62bb6b64c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.318147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-3939ad36-9a38-4eed-9cab-e8f62bb6b64c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:56.319414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3939ad36-9a38-4eed-9cab-e8f62bb6b64c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:56.433457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 749/1495] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:56.438382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd5f92-6975-4dce-9fae-efb9cce7fdd4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.439654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fecd5f92-6975-4dce-9fae-efb9cce7fdd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:56.452514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecd5f92-6975-4dce-9fae-efb9cce7fdd4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.530326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.575731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.576348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.576623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.576888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.577534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:01:56.577829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.578887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WARNING py.warnings [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:01:56.578887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: warnings.warn(msg) Aug 18 21:01:56.578887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: Aug 18 21:01:56.579779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.597042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 747/1496] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:01:56.606289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939ad36-9a38-4eed-9cab-e8f62bb6b64c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.616501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939ad36-9a38-4eed-9cab-e8f62bb6b64c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.694884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:56.731965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cbabf-c79e-47a1-a59a-5da080207f7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.732595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cbabf-c79e-47a1-a59a-5da080207f7a admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.732873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cbabf-c79e-47a1-a59a-5da080207f7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.733142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473cbabf-c79e-47a1-a59a-5da080207f7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.733768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cbabf-c79e-47a1-a59a-5da080207f7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.735573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: WARNING py.warnings [None req-473cbabf-c79e-47a1-a59a-5da080207f7a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:01:56.735573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: warnings.warn(msg) Aug 18 21:01:56.735573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: Aug 18 21:01:56.736786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473cbabf-c79e-47a1-a59a-5da080207f7a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:56.809173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 750/1497] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:01:56 2022] POST /identity/v3/projects => generated 377 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:56.813901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:56.815478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:56.851475 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829e15d-5ea9-4199-bd3d-03fd43b318cc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:56.949841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fab25d-e8d3-48c5-8fed-9a9adcd6e4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:56.950357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fab25d-e8d3-48c5-8fed-9a9adcd6e4c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:56.950627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fab25d-e8d3-48c5-8fed-9a9adcd6e4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:56.950938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fab25d-e8d3-48c5-8fed-9a9adcd6e4c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:56.951979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fab25d-e8d3-48c5-8fed-9a9adcd6e4c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:56.953908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WARNING py.warnings [None req-f3fab25d-e8d3-48c5-8fed-9a9adcd6e4c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:01:56.953908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: warnings.warn(msg) Aug 18 21:01:56.953908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: Aug 18 21:01:56.955172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fab25d-e8d3-48c5-8fed-9a9adcd6e4c0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:57.007607 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 748/1498] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:01:56 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:01:57.012032 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cbabf-c79e-47a1-a59a-5da080207f7a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:57.013649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-473cbabf-c79e-47a1-a59a-5da080207f7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:57.077246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473cbabf-c79e-47a1-a59a-5da080207f7a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:57.168815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:57.180986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27286643-c6e4-4357-a791-7748e42f3fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:57.181608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27286643-c6e4-4357-a791-7748e42f3fab admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.181883 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27286643-c6e4-4357-a791-7748e42f3fab admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.182140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27286643-c6e4-4357-a791-7748e42f3fab admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.182791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27286643-c6e4-4357-a791-7748e42f3fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:57.183836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: WARNING py.warnings [None req-27286643-c6e4-4357-a791-7748e42f3fab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:01:57.183836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: warnings.warn(msg) Aug 18 21:01:57.183836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: Aug 18 21:01:57.184768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27286643-c6e4-4357-a791-7748e42f3fab admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:57.198245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 751/1499] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:01:57.202553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fab25d-e8d3-48c5-8fed-9a9adcd6e4c0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:57.204061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f3fab25d-e8d3-48c5-8fed-9a9adcd6e4c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:57.215813 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fab25d-e8d3-48c5-8fed-9a9adcd6e4c0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:57.242432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:57.317635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b349e97-0659-4061-b266-605a70bbb1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:57.318240 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349e97-0659-4061-b266-605a70bbb1ca admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.318512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349e97-0659-4061-b266-605a70bbb1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.318751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b349e97-0659-4061-b266-605a70bbb1ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.319460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b349e97-0659-4061-b266-605a70bbb1ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:57.320441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WARNING py.warnings [None req-5b349e97-0659-4061-b266-605a70bbb1ca admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:01:57.320441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: warnings.warn(msg) Aug 18 21:01:57.320441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: Aug 18 21:01:57.321386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b349e97-0659-4061-b266-605a70bbb1ca admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:57.334606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 749/1500] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:01:57.340239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27286643-c6e4-4357-a791-7748e42f3fab admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:57.342597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-27286643-c6e4-4357-a791-7748e42f3fab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:57.381708 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27286643-c6e4-4357-a791-7748e42f3fab admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:57.481424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f38bbe-a03e-4dd9-81be-5f9cf52218f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:57.482103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38bbe-a03e-4dd9-81be-5f9cf52218f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.482378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38bbe-a03e-4dd9-81be-5f9cf52218f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.482650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f38bbe-a03e-4dd9-81be-5f9cf52218f2 admin admin] PATH_INFO: `/v3/projects/4a515f6734ba40898629aaa49974907e/users/f875d135d84b488b9a0adbcc68e229d1/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.507575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f38bbe-a03e-4dd9-81be-5f9cf52218f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a515f6734ba40898629aaa49974907e, user_id=f875d135d84b488b9a0adbcc68e229d1, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:57.508642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: WARNING py.warnings [None req-a0f38bbe-a03e-4dd9-81be-5f9cf52218f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:01:57.508642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: warnings.warn(msg) Aug 18 21:01:57.508642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: Aug 18 21:01:57.510556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f38bbe-a03e-4dd9-81be-5f9cf52218f2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:57.540445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 752/1501] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:01:57 2022] PUT /identity/v3/projects/4a515f6734ba40898629aaa49974907e/users/f875d135d84b488b9a0adbcc68e229d1/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:57.553263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894b7ee-d225-42c9-8131-c91214a573df None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.553579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894b7ee-d225-42c9-8131-c91214a573df None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.553853 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b894b7ee-d225-42c9-8131-c91214a573df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.619124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b894b7ee-d225-42c9-8131-c91214a573df None None] MFA Rules not processed for user `f875d135d84b488b9a0adbcc68e229d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:57.620437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b894b7ee-d225-42c9-8131-c91214a573df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:57.711358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 750/1502] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:57.725344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b9830-c656-4643-a595-ba9684e87bb5 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.725633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b9830-c656-4643-a595-ba9684e87bb5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.725904 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5b9830-c656-4643-a595-ba9684e87bb5 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.727304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 753/1503] 10.222.0.59 () {54 vars in 964 bytes} [Thu Aug 18 21:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:57.732372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881d11-f76e-4418-aa9d-44731a9c5371 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:57.732558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881d11-f76e-4418-aa9d-44731a9c5371 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:57.732866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881d11-f76e-4418-aa9d-44731a9c5371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:57.765458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:57.812929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-48881d11-f76e-4418-aa9d-44731a9c5371 None None] MFA Rules not processed for user `7b93049bc8aa47648d101a3f937ca8db`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:57.814136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-48881d11-f76e-4418-aa9d-44731a9c5371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:57.899212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 751/1504] 10.222.0.59 () {58 vars in 1061 bytes} [Thu Aug 18 21:01:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:01:57.908081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b9830-c656-4643-a595-ba9684e87bb5 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:57.910492 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-af5b9830-c656-4643-a595-ba9684e87bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:57.964498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:58.029519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5b9830-c656-4643-a595-ba9684e87bb5 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:58.114676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50f9ed-9ad3-4392-a253-0134b60f92a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:58.115327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50f9ed-9ad3-4392-a253-0134b60f92a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.115593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50f9ed-9ad3-4392-a253-0134b60f92a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.115869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d50f9ed-9ad3-4392-a253-0134b60f92a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.117478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5d50f9ed-9ad3-4392-a253-0134b60f92a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:58.240523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50f9ed-9ad3-4392-a253-0134b60f92a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:58.241981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d50f9ed-9ad3-4392-a253-0134b60f92a0 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:58.245479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:58.261195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 754/1505] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:01:58.311155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ac16-96a2-456f-85b0-6826f00e9b32 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.311632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ac16-96a2-456f-85b0-6826f00e9b32 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.311927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed49ac16-96a2-456f-85b0-6826f00e9b32 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.313736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 752/1506] 10.222.0.59 () {52 vars in 830 bytes} [Thu Aug 18 21:01:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:01:58.326053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50f9ed-9ad3-4392-a253-0134b60f92a0 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:58.327347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5d50f9ed-9ad3-4392-a253-0134b60f92a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:58.444302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d50f9ed-9ad3-4392-a253-0134b60f92a0 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:58.548544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:58.549086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.549364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.549639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] PATH_INFO: `/v3/users/f875d135d84b488b9a0adbcc68e229d1` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.563020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=f875d135d84b488b9a0adbcc68e229d1)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:58.564060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: WARNING py.warnings [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:01:58.564060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: warnings.warn(msg) Aug 18 21:01:58.564060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: Aug 18 21:01:58.565296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:58.576273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:58.643029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f875d135d84b488b9a0adbcc68e229d1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:58.671067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f875d135d84b488b9a0adbcc68e229d1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:58.682712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f875d135d84b488b9a0adbcc68e229d1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:58.698735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f875d135d84b488b9a0adbcc68e229d1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:58.699259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f875d135d84b488b9a0adbcc68e229d1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:58.705197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 755/1507] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:01:58 2022] DELETE /identity/v3/users/f875d135d84b488b9a0adbcc68e229d1 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:01:58.709804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1874160-9dbb-400c-aa7c-1b07d9f1cf5e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:58.710103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1874160-9dbb-400c-aa7c-1b07d9f1cf5e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:58.710366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1874160-9dbb-400c-aa7c-1b07d9f1cf5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:58.768752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b1874160-9dbb-400c-aa7c-1b07d9f1cf5e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:01:58.770461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b1874160-9dbb-400c-aa7c-1b07d9f1cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:58.851679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:58.866142 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 753/1508] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:01:58.877300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:58.878557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:58.987900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930c036d-9767-4213-8b5a-3580fd35e0cf admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.049120 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:01:59.071369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6cf33d-9b68-40df-9190-fafb74edd243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:59.072027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf33d-9b68-40df-9190-fafb74edd243 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.072305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf33d-9b68-40df-9190-fafb74edd243 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.072574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6cf33d-9b68-40df-9190-fafb74edd243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.074174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5d6cf33d-9b68-40df-9190-fafb74edd243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:59.198361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cf33d-9b68-40df-9190-fafb74edd243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:59.200229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6cf33d-9b68-40df-9190-fafb74edd243 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.221612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 756/1509] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:01:59.590314 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1874160-9dbb-400c-aa7c-1b07d9f1cf5e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:01:59.591804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b1874160-9dbb-400c-aa7c-1b07d9f1cf5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:01:59.606881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1874160-9dbb-400c-aa7c-1b07d9f1cf5e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:01:59.705734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:01:59.706522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:01:59.706896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:01:59.707294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] PATH_INFO: `/v3/projects/4a515f6734ba40898629aaa49974907e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:01:59.719663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a515f6734ba40898629aaa49974907e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:01:59.720713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WARNING py.warnings [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:01:59.720713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: warnings.warn(msg) Aug 18 21:01:59.720713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: Aug 18 21:01:59.721921 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:01:59.787459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a515f6734ba40898629aaa49974907e', 'request_id': 'req-d7c09d55-d367-4da3-bb65-cecda518065d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:59.799007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a515f6734ba40898629aaa49974907e', 'request_id': 'req-d7c09d55-d367-4da3-bb65-cecda518065d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:59.812520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a515f6734ba40898629aaa49974907e', 'request_id': 'req-d7c09d55-d367-4da3-bb65-cecda518065d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:59.838319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] The token cache is being invalidate because project 4a515f6734ba40898629aaa49974907e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:01:59.838631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:59.839193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d7c09d55-d367-4da3-bb65-cecda518065d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:01:59.840500 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 754/1510] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:01:59 2022] DELETE /identity/v3/projects/4a515f6734ba40898629aaa49974907e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:02:09.218630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=62 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:02:09.835794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:34.360310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5136e-2967-4238-811b-7ff852e5558a None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:34.361260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5136e-2967-4238-811b-7ff852e5558a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:34.361260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5136e-2967-4238-811b-7ff852e5558a None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:34.363481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:03:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:34.369664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2fa5-1b86-4a8c-910f-e252dfaf4a9a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:34.370135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2fa5-1b86-4a8c-910f-e252dfaf4a9a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:34.370236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026d2fa5-1b86-4a8c-910f-e252dfaf4a9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:34.455736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-026d2fa5-1b86-4a8c-910f-e252dfaf4a9a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:34.457034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-026d2fa5-1b86-4a8c-910f-e252dfaf4a9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:34.587132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:03:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:34.745340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5136e-2967-4238-811b-7ff852e5558a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:34.748127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a2a5136e-2967-4238-811b-7ff852e5558a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:34.881422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5136e-2967-4238-811b-7ff852e5558a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:34.887479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07368-9dcb-41b4-b579-d09b1b53c823 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:34.888121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07368-9dcb-41b4-b579-d09b1b53c823 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:34.888399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07368-9dcb-41b4-b579-d09b1b53c823 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:34.888663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07368-9dcb-41b4-b579-d09b1b53c823 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:34.897439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e07368-9dcb-41b4-b579-d09b1b53c823 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:34.899072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e07368-9dcb-41b4-b579-d09b1b53c823 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:34.908592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 758/1513] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:35.761369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c0d05-f769-4360-a6f3-21c1c8db1327 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:35.761990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c0d05-f769-4360-a6f3-21c1c8db1327 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:35.761990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01c0d05-f769-4360-a6f3-21c1c8db1327 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:35.763338 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:35.769752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e4bb-c115-448c-83e8-642a70667ef6 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:35.770453 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e4bb-c115-448c-83e8-642a70667ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:35.770612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a5e4bb-c115-448c-83e8-642a70667ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:35.797518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-e9a5e4bb-c115-448c-83e8-642a70667ef6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:35.799551 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e9a5e4bb-c115-448c-83e8-642a70667ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:35.813991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:03:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:35.972056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c0d05-f769-4360-a6f3-21c1c8db1327 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:35.994486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01c0d05-f769-4360-a6f3-21c1c8db1327 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:36.000645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4b6285-15b1-4a4c-89e6-3aea465f4671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:36.001278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6285-15b1-4a4c-89e6-3aea465f4671 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:36.001578 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6285-15b1-4a4c-89e6-3aea465f4671 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:36.001843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4b6285-15b1-4a4c-89e6-3aea465f4671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:36.010575 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6285-15b1-4a4c-89e6-3aea465f4671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:36.012281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4b6285-15b1-4a4c-89e6-3aea465f4671 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:36.022391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 757/1516] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:37.949805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99371e93-dc36-4d8b-b1df-2eca58658ab1 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:37.950391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99371e93-dc36-4d8b-b1df-2eca58658ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:37.950391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99371e93-dc36-4d8b-b1df-2eca58658ab1 None None] PATH_INFO: `/v3` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:37.951611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 760/1517] 10.222.0.73 () {54 vars in 925 bytes} [Thu Aug 18 21:03:37 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:03:37.958321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951cadf-37ba-4ae0-9a8c-0a7f4d2ceeab None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:37.958799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951cadf-37ba-4ae0-9a8c-0a7f4d2ceeab None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:37.958919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951cadf-37ba-4ae0-9a8c-0a7f4d2ceeab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:38.024818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5951cadf-37ba-4ae0-9a8c-0a7f4d2ceeab None None] MFA Rules not processed for user `16a4ba52fe124009a570fd1408903cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:38.026061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5951cadf-37ba-4ae0-9a8c-0a7f4d2ceeab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:38.045340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:38.104856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 758/1518] 10.222.0.73 () {58 vars in 1015 bytes} [Thu Aug 18 21:03:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:42.322897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97793-e6a5-432a-8f73-7fc2767fc38c None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:42.323464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97793-e6a5-432a-8f73-7fc2767fc38c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:42.323464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb97793-e6a5-432a-8f73-7fc2767fc38c None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:42.324822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 761/1519] 10.222.0.59 () {54 vars in 961 bytes} [Thu Aug 18 21:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:42.331064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0efe2-f2ad-483a-90dd-5f1a44bf84ec None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:42.331645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0efe2-f2ad-483a-90dd-5f1a44bf84ec None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:42.331645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d0efe2-f2ad-483a-90dd-5f1a44bf84ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:42.369636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d6d0efe2-f2ad-483a-90dd-5f1a44bf84ec None None] MFA Rules not processed for user `16a4ba52fe124009a570fd1408903cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:42.371032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d6d0efe2-f2ad-483a-90dd-5f1a44bf84ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:42.383283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 759/1520] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Aug 18 21:03:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:42.396058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb97793-e6a5-432a-8f73-7fc2767fc38c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:42.414247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb97793-e6a5-432a-8f73-7fc2767fc38c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:42.421173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711c93a1-9b1d-4002-8663-d34106208dd2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:42.421793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c93a1-9b1d-4002-8663-d34106208dd2 service placement] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:42.422096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c93a1-9b1d-4002-8663-d34106208dd2 service placement] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:42.422366 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711c93a1-9b1d-4002-8663-d34106208dd2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:42.434131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c93a1-9b1d-4002-8663-d34106208dd2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:42.437773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711c93a1-9b1d-4002-8663-d34106208dd2 service placement] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:42.448751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 762/1521] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:47.272307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e197ec-7c69-4e14-9dd0-071dc46ba96b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:47.272908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e197ec-7c69-4e14-9dd0-071dc46ba96b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:47.272908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e197ec-7c69-4e14-9dd0-071dc46ba96b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:47.274267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:47.280137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d073-c2b2-42fe-99c2-abc3f07c9dd9 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:47.280582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d073-c2b2-42fe-99c2-abc3f07c9dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:47.280686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730d073-c2b2-42fe-99c2-abc3f07c9dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:47.301626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-6730d073-c2b2-42fe-99c2-abc3f07c9dd9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:47.302831 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6730d073-c2b2-42fe-99c2-abc3f07c9dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:47.312406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:47.467814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e197ec-7c69-4e14-9dd0-071dc46ba96b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:47.490713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e197ec-7c69-4e14-9dd0-071dc46ba96b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:47.499739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d3b8c3-641a-40c9-a6ab-96c572f78404 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:47.500356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b8c3-641a-40c9-a6ab-96c572f78404 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:47.500637 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b8c3-641a-40c9-a6ab-96c572f78404 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:47.500909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d3b8c3-641a-40c9-a6ab-96c572f78404 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:47.509785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3b8c3-641a-40c9-a6ab-96c572f78404 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:47.511424 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d3b8c3-641a-40c9-a6ab-96c572f78404 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:47.522091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 761/1524] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:48.347140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf4313-55ed-4986-aa8e-71445ca4c306 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:48.347962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf4313-55ed-4986-aa8e-71445ca4c306 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:48.347962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbf4313-55ed-4986-aa8e-71445ca4c306 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:48.349410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 18 21:03:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:48.357768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8e0d9-d62e-4514-bc25-77b4d9917927 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:48.358217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8e0d9-d62e-4514-bc25-77b4d9917927 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:48.358330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd8e0d9-d62e-4514-bc25-77b4d9917927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:48.384688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6fd8e0d9-d62e-4514-bc25-77b4d9917927 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:48.385905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6fd8e0d9-d62e-4514-bc25-77b4d9917927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:48.396248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 18 21:03:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:48.564858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf4313-55ed-4986-aa8e-71445ca4c306 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:48.585350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbf4313-55ed-4986-aa8e-71445ca4c306 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:48.591988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2039a9c-41d8-4eaa-940f-1c8d81822d18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:48.592596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2039a9c-41d8-4eaa-940f-1c8d81822d18 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:48.592869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2039a9c-41d8-4eaa-940f-1c8d81822d18 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:48.593135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2039a9c-41d8-4eaa-940f-1c8d81822d18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:48.601461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2039a9c-41d8-4eaa-940f-1c8d81822d18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:48.603143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2039a9c-41d8-4eaa-940f-1c8d81822d18 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:48.613863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 765/1527] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:52.524062 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc45e2-5e0f-4a3e-ac87-36b3c7bd3c66 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:52.524660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc45e2-5e0f-4a3e-ac87-36b3c7bd3c66 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:52.524660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc45e2-5e0f-4a3e-ac87-36b3c7bd3c66 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:52.526761 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:03:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:52.534451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a6a88-348d-4129-842d-88cda3ea83d5 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:52.534908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a6a88-348d-4129-842d-88cda3ea83d5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:52.535063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2a6a88-348d-4129-842d-88cda3ea83d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:52.564899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-6a2a6a88-348d-4129-842d-88cda3ea83d5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:52.566119 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6a2a6a88-348d-4129-842d-88cda3ea83d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:52.579285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:52.876676 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc45e2-5e0f-4a3e-ac87-36b3c7bd3c66 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:52.878588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dafc45e2-5e0f-4a3e-ac87-36b3c7bd3c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:52.962989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc45e2-5e0f-4a3e-ac87-36b3c7bd3c66 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:52.967275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8acebcc-f62d-469b-80c9-e4ce11680750 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:52.967878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acebcc-f62d-469b-80c9-e4ce11680750 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:52.968151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acebcc-f62d-469b-80c9-e4ce11680750 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:52.968418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8acebcc-f62d-469b-80c9-e4ce11680750 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:52.977574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acebcc-f62d-469b-80c9-e4ce11680750 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:52.979064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8acebcc-f62d-469b-80c9-e4ce11680750 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:52.988466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 764/1530] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:03:54.886824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17da5b-0786-43d9-b089-1b4eeec385df None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:54.888123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17da5b-0786-43d9-b089-1b4eeec385df None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:54.888123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e17da5b-0786-43d9-b089-1b4eeec385df None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:54.890129 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:03:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:54.896882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6ce6-b87e-4c41-82e4-0639f216071c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:54.897636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6ce6-b87e-4c41-82e4-0639f216071c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:54.897804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd6ce6-b87e-4c41-82e4-0639f216071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:54.920961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7bfd6ce6-b87e-4c41-82e4-0639f216071c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:54.922187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7bfd6ce6-b87e-4c41-82e4-0639f216071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:54.930864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:55.218660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17da5b-0786-43d9-b089-1b4eeec385df None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:55.235299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e17da5b-0786-43d9-b089-1b4eeec385df None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:55.239429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f44edb-5771-4e40-a876-f53d1ed284f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:55.240038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44edb-5771-4e40-a876-f53d1ed284f3 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:55.240317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44edb-5771-4e40-a876-f53d1ed284f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:55.240592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f44edb-5771-4e40-a876-f53d1ed284f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:55.249888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44edb-5771-4e40-a876-f53d1ed284f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:55.251420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f44edb-5771-4e40-a876-f53d1ed284f3 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:55.261089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 768/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:03:58.742574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9dad-f58e-4c3c-92a8-5f968e77b8c0 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:58.743178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9dad-f58e-4c3c-92a8-5f968e77b8c0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:58.743178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c9dad-f58e-4c3c-92a8-5f968e77b8c0 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:58.749066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:03:58.751032 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dd977-eea1-49f1-aa6c-c1415cb4a721 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:58.751523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dd977-eea1-49f1-aa6c-c1415cb4a721 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:58.751632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3dd977-eea1-49f1-aa6c-c1415cb4a721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:58.777066 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ad3dd977-eea1-49f1-aa6c-c1415cb4a721 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:03:58.779099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ad3dd977-eea1-49f1-aa6c-c1415cb4a721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:58.789143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:03:59.349526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c9dad-f58e-4c3c-92a8-5f968e77b8c0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:03:59.352644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-655c9dad-f58e-4c3c-92a8-5f968e77b8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:03:59.432909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:03:59.448169 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c9dad-f58e-4c3c-92a8-5f968e77b8c0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:03:59.451970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2331c3bb-9fda-4f77-afde-2d0d2c0e5f03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:03:59.452572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c3bb-9fda-4f77-afde-2d0d2c0e5f03 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:03:59.452934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c3bb-9fda-4f77-afde-2d0d2c0e5f03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:03:59.453196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2331c3bb-9fda-4f77-afde-2d0d2c0e5f03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:03:59.463622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331c3bb-9fda-4f77-afde-2d0d2c0e5f03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:03:59.465073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2331c3bb-9fda-4f77-afde-2d0d2c0e5f03 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:03:59.475255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 767/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:01.439422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9146-0e4a-4646-b685-64247eff08af None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:01.439973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9146-0e4a-4646-b685-64247eff08af None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:01.439973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3b9146-0e4a-4646-b685-64247eff08af None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:01.441260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 18 21:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:04:01.447442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d48a-a627-4056-9b07-8407188997b4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:01.448267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d48a-a627-4056-9b07-8407188997b4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:01.448267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e6d48a-a627-4056-9b07-8407188997b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:01.470823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-67e6d48a-a627-4056-9b07-8407188997b4 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:04:01.472051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-67e6d48a-a627-4056-9b07-8407188997b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:01.481595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 18 21:04:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:04:02.062887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b9146-0e4a-4646-b685-64247eff08af None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:04:02.064982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-1b3b9146-0e4a-4646-b685-64247eff08af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:04:02.073810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=84 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:02.081704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3b9146-0e4a-4646-b685-64247eff08af None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:04:02.085316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c463c9f-2571-44e4-8678-645cd43d5a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:04:02.085922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c463c9f-2571-44e4-8678-645cd43d5a26 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:04:02.086201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c463c9f-2571-44e4-8678-645cd43d5a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:04:02.086475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c463c9f-2571-44e4-8678-645cd43d5a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:04:02.096167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c463c9f-2571-44e4-8678-645cd43d5a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:04:02.097615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c463c9f-2571-44e4-8678-645cd43d5a26 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:04:02.107075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 771/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:04:11.465953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=11 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:04:12.103812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:28.700471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b02ed-4f26-45df-a596-e8d2ba54768c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.702344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b02ed-4f26-45df-a596-e8d2ba54768c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.702344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976b02ed-4f26-45df-a596-e8d2ba54768c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.731474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-976b02ed-4f26-45df-a596-e8d2ba54768c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:28.732775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-976b02ed-4f26-45df-a596-e8d2ba54768c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:28.749238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 769/1540] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:28.764781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3466075-6aa7-483d-a010-3df9fb835a51 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.765391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3466075-6aa7-483d-a010-3df9fb835a51 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.765391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3466075-6aa7-483d-a010-3df9fb835a51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.801462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-c3466075-6aa7-483d-a010-3df9fb835a51 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:28.802684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c3466075-6aa7-483d-a010-3df9fb835a51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:28.814390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 772/1541] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:28.819533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b02ed-4f26-45df-a596-e8d2ba54768c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:28.832855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976b02ed-4f26-45df-a596-e8d2ba54768c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:28.838393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f610b67-e033-40c5-8af9-41967ecbd309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:28.839047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f610b67-e033-40c5-8af9-41967ecbd309 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.839323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f610b67-e033-40c5-8af9-41967ecbd309 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.839602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f610b67-e033-40c5-8af9-41967ecbd309 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.840261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f610b67-e033-40c5-8af9-41967ecbd309 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:28.840562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f610b67-e033-40c5-8af9-41967ecbd309 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:28.842318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f610b67-e033-40c5-8af9-41967ecbd309 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:28.861372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 770/1542] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:28.870321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3466075-6aa7-483d-a010-3df9fb835a51 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:28.883251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3466075-6aa7-483d-a010-3df9fb835a51 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:28.890904 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79de0c5-dba3-415e-8558-9d6a315f4aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:28.891549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79de0c5-dba3-415e-8558-9d6a315f4aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.891830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79de0c5-dba3-415e-8558-9d6a315f4aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.892097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79de0c5-dba3-415e-8558-9d6a315f4aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.892746 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79de0c5-dba3-415e-8558-9d6a315f4aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:28.895222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79de0c5-dba3-415e-8558-9d6a315f4aa7 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:28.950900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbff0-f4aa-424d-8993-0c7ba05922e4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.951133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbff0-f4aa-424d-8993-0c7ba05922e4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.952157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcfbff0-f4aa-424d-8993-0c7ba05922e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:28.992943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 773/1543] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:28.994287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a219d2-f7ae-41dd-ac98-603694d215f3 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:28.994572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a219d2-f7ae-41dd-ac98-603694d215f3 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:28.994879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a219d2-f7ae-41dd-ac98-603694d215f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.001398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2dcfbff0-f4aa-424d-8993-0c7ba05922e4 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.002904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2dcfbff0-f4aa-424d-8993-0c7ba05922e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.043767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-42a219d2-f7ae-41dd-ac98-603694d215f3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.045057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-42a219d2-f7ae-41dd-ac98-603694d215f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.130367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 771/1544] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Aug 18 21:05:29.132142 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d90af-789a-4b19-b423-79e598f6a901 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.132434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d90af-789a-4b19-b423-79e598f6a901 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.132709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9d90af-789a-4b19-b423-79e598f6a901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.155177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4b9d90af-789a-4b19-b423-79e598f6a901 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.156432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 774/1545] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.156714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4b9d90af-789a-4b19-b423-79e598f6a901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.157262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a219d2-f7ae-41dd-ac98-603694d215f3 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.169499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a219d2-f7ae-41dd-ac98-603694d215f3 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.171679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 772/1546] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.172929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1f0a6-2d4c-4fc2-ab71-2ecc72b06579 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.173212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1f0a6-2d4c-4fc2-ab71-2ecc72b06579 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.173479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c1f0a6-2d4c-4fc2-ab71-2ecc72b06579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.178444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65df2fd-b5b0-438d-ba14-3ddb4dba0201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.179105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df2fd-b5b0-438d-ba14-3ddb4dba0201 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.179452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df2fd-b5b0-438d-ba14-3ddb4dba0201 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.179743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65df2fd-b5b0-438d-ba14-3ddb4dba0201 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.180370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65df2fd-b5b0-438d-ba14-3ddb4dba0201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.181400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: WARNING py.warnings [None req-d65df2fd-b5b0-438d-ba14-3ddb4dba0201 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:05:29.181400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: warnings.warn(msg) Aug 18 21:05:29.181400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: Aug 18 21:05:29.182590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65df2fd-b5b0-438d-ba14-3ddb4dba0201 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.193085 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d2c1f0a6-2d4c-4fc2-ab71-2ecc72b06579 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.194278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d2c1f0a6-2d4c-4fc2-ab71-2ecc72b06579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.203333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 773/1547] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.209822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 775/1548] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:29.209822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23436c71-ad66-4319-8e7d-65630da2f008 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.209822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23436c71-ad66-4319-8e7d-65630da2f008 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.209822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23436c71-ad66-4319-8e7d-65630da2f008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.211309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d7d6-a954-47e5-9857-1f00cfa29a4d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.211600 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d7d6-a954-47e5-9857-1f00cfa29a4d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.211881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d531d7d6-a954-47e5-9857-1f00cfa29a4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.229655 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-23436c71-ad66-4319-8e7d-65630da2f008 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.230431 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-23436c71-ad66-4319-8e7d-65630da2f008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.231384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d531d7d6-a954-47e5-9857-1f00cfa29a4d None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.232633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d531d7d6-a954-47e5-9857-1f00cfa29a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.239608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 776/1549] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.240714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c996a-a59e-4af6-a01a-4b18c606fa27 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.241002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c996a-a59e-4af6-a01a-4b18c606fa27 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.241114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 774/1550] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.241275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c996a-a59e-4af6-a01a-4b18c606fa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.242343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5df9-38ad-44e8-b723-5faee06455b8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.242627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5df9-38ad-44e8-b723-5faee06455b8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.242936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd5df9-38ad-44e8-b723-5faee06455b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.262016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ef5c996a-a59e-4af6-a01a-4b18c606fa27 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.263328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ef5c996a-a59e-4af6-a01a-4b18c606fa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.267505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3fcd5df9-38ad-44e8-b723-5faee06455b8 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.268669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3fcd5df9-38ad-44e8-b723-5faee06455b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.272192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 777/1551] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.273407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307e59-a356-42e5-b8e9-2d0020df8589 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.273693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307e59-a356-42e5-b8e9-2d0020df8589 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.273957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14307e59-a356-42e5-b8e9-2d0020df8589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.277252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 775/1552] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.278655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76e69-0bf3-41f2-bf78-c72ac7427f30 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.278969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76e69-0bf3-41f2-bf78-c72ac7427f30 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.279335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76e69-0bf3-41f2-bf78-c72ac7427f30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.294595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-14307e59-a356-42e5-b8e9-2d0020df8589 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.296056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-14307e59-a356-42e5-b8e9-2d0020df8589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.299048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-edf76e69-0bf3-41f2-bf78-c72ac7427f30 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.300201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-edf76e69-0bf3-41f2-bf78-c72ac7427f30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.304158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 778/1553] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.305030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307e59-a356-42e5-b8e9-2d0020df8589 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.308229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 776/1554] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.309523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc78ee9-384b-465b-8364-7e804a308659 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.309747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc78ee9-384b-465b-8364-7e804a308659 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.310021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc78ee9-384b-465b-8364-7e804a308659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.315166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14307e59-a356-42e5-b8e9-2d0020df8589 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.320105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9481285-3556-4976-83d0-b877e5fbbecf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.320818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9481285-3556-4976-83d0-b877e5fbbecf admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.321100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9481285-3556-4976-83d0-b877e5fbbecf admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.321368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9481285-3556-4976-83d0-b877e5fbbecf admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.322164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9481285-3556-4976-83d0-b877e5fbbecf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.323800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9481285-3556-4976-83d0-b877e5fbbecf admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.330179 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4cc78ee9-384b-465b-8364-7e804a308659 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.331410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4cc78ee9-384b-465b-8364-7e804a308659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.334087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 779/1555] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:29.335293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7419e-b764-42bf-94c6-73a79a7aaf27 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.335571 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7419e-b764-42bf-94c6-73a79a7aaf27 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.335836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f7419e-b764-42bf-94c6-73a79a7aaf27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.341417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 777/1556] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.342642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105422-8e09-4c3c-aa57-84ec9fb11c76 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.342959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105422-8e09-4c3c-aa57-84ec9fb11c76 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.343233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb105422-8e09-4c3c-aa57-84ec9fb11c76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.357710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-79f7419e-b764-42bf-94c6-73a79a7aaf27 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.358949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-79f7419e-b764-42bf-94c6-73a79a7aaf27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.366875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 780/1557] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.367676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7419e-b764-42bf-94c6-73a79a7aaf27 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.371169 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bb105422-8e09-4c3c-aa57-84ec9fb11c76 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.372644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bb105422-8e09-4c3c-aa57-84ec9fb11c76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.376911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f7419e-b764-42bf-94c6-73a79a7aaf27 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.381444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b0212-9dbd-4041-be0e-040ff1c7026e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.381577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 778/1558] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.382073 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b0212-9dbd-4041-be0e-040ff1c7026e admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.382363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b0212-9dbd-4041-be0e-040ff1c7026e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.382618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b0212-9dbd-4041-be0e-040ff1c7026e admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.382730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b69f69-a61d-425d-98f8-b91650a5bf5a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.382979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b69f69-a61d-425d-98f8-b91650a5bf5a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.383250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b69f69-a61d-425d-98f8-b91650a5bf5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.383364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b0212-9dbd-4041-be0e-040ff1c7026e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:29.383586 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b0212-9dbd-4041-be0e-040ff1c7026e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.384606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: WARNING py.warnings [None req-e49b0212-9dbd-4041-be0e-040ff1c7026e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:05:29.384606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: warnings.warn(msg) Aug 18 21:05:29.384606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: Aug 18 21:05:29.385729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49b0212-9dbd-4041-be0e-040ff1c7026e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.398359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 781/1559] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:29.399351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b0212-9dbd-4041-be0e-040ff1c7026e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.409484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b0212-9dbd-4041-be0e-040ff1c7026e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.410034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-93b69f69-a61d-425d-98f8-b91650a5bf5a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:29.411283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-93b69f69-a61d-425d-98f8-b91650a5bf5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:29.414382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5cb3f-692b-4706-abe8-9203db76571c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.415016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5cb3f-692b-4706-abe8-9203db76571c admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.415295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5cb3f-692b-4706-abe8-9203db76571c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.415565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b5cb3f-692b-4706-abe8-9203db76571c admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.416365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5cb3f-692b-4706-abe8-9203db76571c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:29.416664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5cb3f-692b-4706-abe8-9203db76571c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.418269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b5cb3f-692b-4706-abe8-9203db76571c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.419487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 779/1560] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:29.423221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b69f69-a61d-425d-98f8-b91650a5bf5a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.430624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b69f69-a61d-425d-98f8-b91650a5bf5a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.436196 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 782/1561] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:29.436196 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5cb3f-692b-4706-abe8-9203db76571c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.440945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a405b5-ce03-44b1-8a76-01aa2fb3267f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.441565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a405b5-ce03-44b1-8a76-01aa2fb3267f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.441842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a405b5-ce03-44b1-8a76-01aa2fb3267f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.442114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a405b5-ce03-44b1-8a76-01aa2fb3267f admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.442909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a405b5-ce03-44b1-8a76-01aa2fb3267f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:29.443022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b5cb3f-692b-4706-abe8-9203db76571c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.443128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a405b5-ce03-44b1-8a76-01aa2fb3267f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.444745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a405b5-ce03-44b1-8a76-01aa2fb3267f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.447629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15d87-436c-4b4c-815e-58ef45c7d002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.448217 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15d87-436c-4b4c-815e-58ef45c7d002 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.448493 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15d87-436c-4b4c-815e-58ef45c7d002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.448760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c15d87-436c-4b4c-815e-58ef45c7d002 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.449392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c15d87-436c-4b4c-815e-58ef45c7d002 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.451006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c15d87-436c-4b4c-815e-58ef45c7d002 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.464565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 780/1562] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:29.464565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a405b5-ce03-44b1-8a76-01aa2fb3267f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.464811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 783/1563] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:29.464811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15d87-436c-4b4c-815e-58ef45c7d002 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.470247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a405b5-ce03-44b1-8a76-01aa2fb3267f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.473361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c15d87-436c-4b4c-815e-58ef45c7d002 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.474815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882e53-8ec4-41b3-a331-d1da9d4180bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.475420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882e53-8ec4-41b3-a331-d1da9d4180bb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.475706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882e53-8ec4-41b3-a331-d1da9d4180bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.475969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0882e53-8ec4-41b3-a331-d1da9d4180bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.476620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882e53-8ec4-41b3-a331-d1da9d4180bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:29.476927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882e53-8ec4-41b3-a331-d1da9d4180bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.478223 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda17e0-2608-4b06-9dbb-ccb72a05d5ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.478533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0882e53-8ec4-41b3-a331-d1da9d4180bb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.478854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda17e0-2608-4b06-9dbb-ccb72a05d5ad admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.479134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda17e0-2608-4b06-9dbb-ccb72a05d5ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.479401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda17e0-2608-4b06-9dbb-ccb72a05d5ad admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.480045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda17e0-2608-4b06-9dbb-ccb72a05d5ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:29.480339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda17e0-2608-4b06-9dbb-ccb72a05d5ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.481922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda17e0-2608-4b06-9dbb-ccb72a05d5ad admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.491056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 781/1564] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:29.501439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 784/1565] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:29.501613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882e53-8ec4-41b3-a331-d1da9d4180bb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.501737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda17e0-2608-4b06-9dbb-ccb72a05d5ad admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.505261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0882e53-8ec4-41b3-a331-d1da9d4180bb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.510189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb95974-8d95-42a5-a5e0-376bcc3a189d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.510804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb95974-8d95-42a5-a5e0-376bcc3a189d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.510924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda17e0-2608-4b06-9dbb-ccb72a05d5ad admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.511084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb95974-8d95-42a5-a5e0-376bcc3a189d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.511347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb95974-8d95-42a5-a5e0-376bcc3a189d admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.511988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb95974-8d95-42a5-a5e0-376bcc3a189d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:29.512281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb95974-8d95-42a5-a5e0-376bcc3a189d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.514047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb95974-8d95-42a5-a5e0-376bcc3a189d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.515373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecd5d-6ef3-4f07-890b-a068fff7b9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.516006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecd5d-6ef3-4f07-890b-a068fff7b9f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.516278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecd5d-6ef3-4f07-890b-a068fff7b9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.516546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baecd5d-6ef3-4f07-890b-a068fff7b9f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.517167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baecd5d-6ef3-4f07-890b-a068fff7b9f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.519456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baecd5d-6ef3-4f07-890b-a068fff7b9f9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.526905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 782/1566] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:29.528523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb95974-8d95-42a5-a5e0-376bcc3a189d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.538952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb95974-8d95-42a5-a5e0-376bcc3a189d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.541239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:29.543741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6752355-6260-4ef5-aa1b-ae6a2cc5edd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.544341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752355-6260-4ef5-aa1b-ae6a2cc5edd6 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.544620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752355-6260-4ef5-aa1b-ae6a2cc5edd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.544985 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6752355-6260-4ef5-aa1b-ae6a2cc5edd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.545735 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6752355-6260-4ef5-aa1b-ae6a2cc5edd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:29.546110 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6752355-6260-4ef5-aa1b-ae6a2cc5edd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.547760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6752355-6260-4ef5-aa1b-ae6a2cc5edd6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.559211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 785/1567] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/projects => generated 393 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:29.559211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecd5d-6ef3-4f07-890b-a068fff7b9f9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.560450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 783/1568] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:29.563691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6752355-6260-4ef5-aa1b-ae6a2cc5edd6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.574053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6752355-6260-4ef5-aa1b-ae6a2cc5edd6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.610719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:29.619091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baecd5d-6ef3-4f07-890b-a068fff7b9f9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.623817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce873b71-2a70-4126-add5-450d78dcdb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.624477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce873b71-2a70-4126-add5-450d78dcdb16 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.624748 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce873b71-2a70-4126-add5-450d78dcdb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.625015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce873b71-2a70-4126-add5-450d78dcdb16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.625635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce873b71-2a70-4126-add5-450d78dcdb16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.627596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce873b71-2a70-4126-add5-450d78dcdb16 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.636014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a83d6-2b13-4a7d-9e60-2dfcd3087128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.636686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a83d6-2b13-4a7d-9e60-2dfcd3087128 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.636966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a83d6-2b13-4a7d-9e60-2dfcd3087128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.637243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a83d6-2b13-4a7d-9e60-2dfcd3087128 admin admin] PATH_INFO: `/v3/projects/fcbd65e8543347109591297794b1056d/users/dda19c20bfec49b8b9e1d589f7e3e188/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.654891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a83d6-2b13-4a7d-9e60-2dfcd3087128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fcbd65e8543347109591297794b1056d, user_id=dda19c20bfec49b8b9e1d589f7e3e188, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.656287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WARNING py.warnings [None req-ba5a83d6-2b13-4a7d-9e60-2dfcd3087128 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:05:29.656287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: warnings.warn(msg) Aug 18 21:05:29.656287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: Aug 18 21:05:29.657411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 786/1569] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:29.658389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5a83d6-2b13-4a7d-9e60-2dfcd3087128 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.659764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce873b71-2a70-4126-add5-450d78dcdb16 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.674211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 784/1570] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:29 2022] PUT /identity/v3/projects/fcbd65e8543347109591297794b1056d/users/dda19c20bfec49b8b9e1d589f7e3e188/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:29.675106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a83d6-2b13-4a7d-9e60-2dfcd3087128 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.727254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce873b71-2a70-4126-add5-450d78dcdb16 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.737569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5a83d6-2b13-4a7d-9e60-2dfcd3087128 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.743140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33c08e-f0e0-41c5-bbf2-89f11df29b27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.743754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33c08e-f0e0-41c5-bbf2-89f11df29b27 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.744033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33c08e-f0e0-41c5-bbf2-89f11df29b27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.744318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f33c08e-f0e0-41c5-bbf2-89f11df29b27 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.744933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33c08e-f0e0-41c5-bbf2-89f11df29b27 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.745982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WARNING py.warnings [None req-0f33c08e-f0e0-41c5-bbf2-89f11df29b27 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:05:29.745982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: warnings.warn(msg) Aug 18 21:05:29.745982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: Aug 18 21:05:29.747210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f33c08e-f0e0-41c5-bbf2-89f11df29b27 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.779464 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 785/1571] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:29.780398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33c08e-f0e0-41c5-bbf2-89f11df29b27 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.792859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e00162-7ff6-436d-9de2-b46c0f2e1dcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.793574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e00162-7ff6-436d-9de2-b46c0f2e1dcc admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.793885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e00162-7ff6-436d-9de2-b46c0f2e1dcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.794153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e00162-7ff6-436d-9de2-b46c0f2e1dcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.794885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e00162-7ff6-436d-9de2-b46c0f2e1dcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.797368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e00162-7ff6-436d-9de2-b46c0f2e1dcc admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.825005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 787/1572] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/projects => generated 373 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:29.826006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e00162-7ff6-436d-9de2-b46c0f2e1dcc admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.839757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:29.844845 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f33c08e-f0e0-41c5-bbf2-89f11df29b27 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.892739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:29.893061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e00162-7ff6-436d-9de2-b46c0f2e1dcc admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:29.898444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c216-0d44-4460-aa46-7a90745494f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.899104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c216-0d44-4460-aa46-7a90745494f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.899467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c216-0d44-4460-aa46-7a90745494f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.899746 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1002c216-0d44-4460-aa46-7a90745494f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.900444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002c216-0d44-4460-aa46-7a90745494f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.902392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1002c216-0d44-4460-aa46-7a90745494f9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.904984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83016b18-dd95-4080-b29f-1875a39d5530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:29.905601 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016b18-dd95-4080-b29f-1875a39d5530 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:29.905883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016b18-dd95-4080-b29f-1875a39d5530 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:29.906275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83016b18-dd95-4080-b29f-1875a39d5530 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:29.906956 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83016b18-dd95-4080-b29f-1875a39d5530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:29.908908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83016b18-dd95-4080-b29f-1875a39d5530 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:29.933095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 788/1573] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:29.934230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c216-0d44-4460-aa46-7a90745494f9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.936803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 786/1574] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/projects => generated 365 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:29.937656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83016b18-dd95-4080-b29f-1875a39d5530 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:29.998867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83016b18-dd95-4080-b29f-1875a39d5530 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.000842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1002c216-0d44-4460-aa46-7a90745494f9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.003945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f95de7-cbae-4f70-81d2-27fbf38323d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.004556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95de7-cbae-4f70-81d2-27fbf38323d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.004828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95de7-cbae-4f70-81d2-27fbf38323d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.005123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f95de7-cbae-4f70-81d2-27fbf38323d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.005657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295af52-d19b-4533-9b38-8a23339bd685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.005797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f95de7-cbae-4f70-81d2-27fbf38323d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.006306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295af52-d19b-4533-9b38-8a23339bd685 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.006590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295af52-d19b-4533-9b38-8a23339bd685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.006927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1295af52-d19b-4533-9b38-8a23339bd685 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.007585 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295af52-d19b-4533-9b38-8a23339bd685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.007812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f95de7-cbae-4f70-81d2-27fbf38323d0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.009703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1295af52-d19b-4533-9b38-8a23339bd685 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.039496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 789/1575] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:30.039496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295af52-d19b-4533-9b38-8a23339bd685 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.042258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 787/1576] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:29 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:30.043514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25b9ef-475f-4d01-8562-b0f5ed54282a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.043868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25b9ef-475f-4d01-8562-b0f5ed54282a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.044251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d25b9ef-475f-4d01-8562-b0f5ed54282a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.049536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1295af52-d19b-4533-9b38-8a23339bd685 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.064178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5d25b9ef-475f-4d01-8562-b0f5ed54282a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:30.065487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5d25b9ef-475f-4d01-8562-b0f5ed54282a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:30.110870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cdaee-c93f-4dca-8f2d-9ba88f5ed8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.111498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cdaee-c93f-4dca-8f2d-9ba88f5ed8dd admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.111778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cdaee-c93f-4dca-8f2d-9ba88f5ed8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.112048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765cdaee-c93f-4dca-8f2d-9ba88f5ed8dd admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.112677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765cdaee-c93f-4dca-8f2d-9ba88f5ed8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.114619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765cdaee-c93f-4dca-8f2d-9ba88f5ed8dd admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.126124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 788/1577] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:30.126991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25b9ef-475f-4d01-8562-b0f5ed54282a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.136776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d25b9ef-475f-4d01-8562-b0f5ed54282a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.141705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f7579-6f0c-4d6e-ac3a-c8673e4cfade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.142308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f7579-6f0c-4d6e-ac3a-c8673e4cfade admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.142587 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f7579-6f0c-4d6e-ac3a-c8673e4cfade admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.142890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403f7579-6f0c-4d6e-ac3a-c8673e4cfade admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.143523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f7579-6f0c-4d6e-ac3a-c8673e4cfade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.145158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 790/1578] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:30 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:30.145795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403f7579-6f0c-4d6e-ac3a-c8673e4cfade admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.145927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cdaee-c93f-4dca-8f2d-9ba88f5ed8dd admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.156291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765cdaee-c93f-4dca-8f2d-9ba88f5ed8dd admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.161534 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aeb58-89b8-4732-b5c2-09d4adbe9588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.162174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aeb58-89b8-4732-b5c2-09d4adbe9588 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.162457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aeb58-89b8-4732-b5c2-09d4adbe9588 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.162731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3aeb58-89b8-4732-b5c2-09d4adbe9588 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.163386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aeb58-89b8-4732-b5c2-09d4adbe9588 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.165530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3aeb58-89b8-4732-b5c2-09d4adbe9588 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.168659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 789/1579] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:30 2022] POST /identity/v3/users => generated 303 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:30.169672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f7579-6f0c-4d6e-ac3a-c8673e4cfade admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.180874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403f7579-6f0c-4d6e-ac3a-c8673e4cfade admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.183316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:30.186414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb71ba-8f22-4ca1-b55a-d130fdb57e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.186922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb71ba-8f22-4ca1-b55a-d130fdb57e88 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.187219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb71ba-8f22-4ca1-b55a-d130fdb57e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.187520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cb71ba-8f22-4ca1-b55a-d130fdb57e88 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.188302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb71ba-8f22-4ca1-b55a-d130fdb57e88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.190274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cb71ba-8f22-4ca1-b55a-d130fdb57e88 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.192909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 791/1580] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:30 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:30.193733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aeb58-89b8-4732-b5c2-09d4adbe9588 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.203837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3aeb58-89b8-4732-b5c2-09d4adbe9588 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.208834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e75cab-1155-466f-a8b8-39a012c49baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.209555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e75cab-1155-466f-a8b8-39a012c49baf admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.210016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e75cab-1155-466f-a8b8-39a012c49baf admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.210178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e75cab-1155-466f-a8b8-39a012c49baf admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.210834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e75cab-1155-466f-a8b8-39a012c49baf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.212780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e75cab-1155-466f-a8b8-39a012c49baf admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.214894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 790/1581] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:30 2022] POST /identity/v3/users => generated 290 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:30.216038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb71ba-8f22-4ca1-b55a-d130fdb57e88 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.230188 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cb71ba-8f22-4ca1-b55a-d130fdb57e88 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.235700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b83237-ff1e-4fd4-9191-37ee826ea79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.236299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b83237-ff1e-4fd4-9191-37ee826ea79f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.236580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b83237-ff1e-4fd4-9191-37ee826ea79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.236848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b83237-ff1e-4fd4-9191-37ee826ea79f admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.237499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b83237-ff1e-4fd4-9191-37ee826ea79f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.239070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 792/1582] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:30 2022] POST /identity/v3/users => generated 283 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:30.239217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b83237-ff1e-4fd4-9191-37ee826ea79f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.239978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e75cab-1155-466f-a8b8-39a012c49baf admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.250499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e75cab-1155-466f-a8b8-39a012c49baf admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.250987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 791/1583] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.252012 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b83237-ff1e-4fd4-9191-37ee826ea79f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.255313 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782c638-4c65-4049-bd7a-0593f68c0cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.255919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782c638-4c65-4049-bd7a-0593f68c0cf2 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.256191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782c638-4c65-4049-bd7a-0593f68c0cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.256457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3782c638-4c65-4049-bd7a-0593f68c0cf2 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.257073 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782c638-4c65-4049-bd7a-0593f68c0cf2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.259243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3782c638-4c65-4049-bd7a-0593f68c0cf2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.270041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:30.284435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 793/1584] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:30 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:30.285323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782c638-4c65-4049-bd7a-0593f68c0cf2 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.296070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3782c638-4c65-4049-bd7a-0593f68c0cf2 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.300850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b216e-b334-4900-8d27-6f51eeb2ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.301594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b216e-b334-4900-8d27-6f51eeb2ace4 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.301874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b216e-b334-4900-8d27-6f51eeb2ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.302145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3b216e-b334-4900-8d27-6f51eeb2ace4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.302815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b216e-b334-4900-8d27-6f51eeb2ace4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.304455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3b216e-b334-4900-8d27-6f51eeb2ace4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.313505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b83237-ff1e-4fd4-9191-37ee826ea79f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.316235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 794/1585] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.317307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78f859-4a2b-47a9-82d5-f81649aa67ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.317592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b216e-b334-4900-8d27-6f51eeb2ace4 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.317920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f859-4a2b-47a9-82d5-f81649aa67ec service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.318200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f859-4a2b-47a9-82d5-f81649aa67ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.318476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc78f859-4a2b-47a9-82d5-f81649aa67ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.332016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3b216e-b334-4900-8d27-6f51eeb2ace4 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.336053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78f859-4a2b-47a9-82d5-f81649aa67ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.336782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afaa83-9e74-4b8b-af6d-afeebdc67575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.337389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afaa83-9e74-4b8b-af6d-afeebdc67575 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.337667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afaa83-9e74-4b8b-af6d-afeebdc67575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.337781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc78f859-4a2b-47a9-82d5-f81649aa67ec service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.337938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65afaa83-9e74-4b8b-af6d-afeebdc67575 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.338581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afaa83-9e74-4b8b-af6d-afeebdc67575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.340226 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65afaa83-9e74-4b8b-af6d-afeebdc67575 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.348152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 792/1586] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:30.349122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78f859-4a2b-47a9-82d5-f81649aa67ec service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.352280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 795/1587] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.353192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afaa83-9e74-4b8b-af6d-afeebdc67575 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.361399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc78f859-4a2b-47a9-82d5-f81649aa67ec service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.363422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65afaa83-9e74-4b8b-af6d-afeebdc67575 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.366936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff66840-5034-4c36-a951-a33dff47313c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.367543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff66840-5034-4c36-a951-a33dff47313c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.367820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff66840-5034-4c36-a951-a33dff47313c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.368132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff66840-5034-4c36-a951-a33dff47313c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.368785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff66840-5034-4c36-a951-a33dff47313c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.368890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925ea63-85f5-40a8-81a7-1e37dbd631be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.369503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ea63-85f5-40a8-81a7-1e37dbd631be admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.370040 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ea63-85f5-40a8-81a7-1e37dbd631be admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.370040 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925ea63-85f5-40a8-81a7-1e37dbd631be admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.370384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff66840-5034-4c36-a951-a33dff47313c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.370666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925ea63-85f5-40a8-81a7-1e37dbd631be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.372461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925ea63-85f5-40a8-81a7-1e37dbd631be admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.385645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 796/1588] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.386316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925ea63-85f5-40a8-81a7-1e37dbd631be admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.389964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 793/1589] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.389964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff66840-5034-4c36-a951-a33dff47313c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.401239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925ea63-85f5-40a8-81a7-1e37dbd631be admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.403553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff66840-5034-4c36-a951-a33dff47313c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.407530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d2783-a352-44bf-aeb1-ace39721716c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.407688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d2783-a352-44bf-aeb1-ace39721716c admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.408084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d2783-a352-44bf-aeb1-ace39721716c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.408421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905d2783-a352-44bf-aeb1-ace39721716c admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.409015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d2783-a352-44bf-aeb1-ace39721716c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.410812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905d2783-a352-44bf-aeb1-ace39721716c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.411091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449966d-a394-4539-b6a1-bc900c261b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.411814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449966d-a394-4539-b6a1-bc900c261b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.412353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449966d-a394-4539-b6a1-bc900c261b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.412691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c449966d-a394-4539-b6a1-bc900c261b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.413526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449966d-a394-4539-b6a1-bc900c261b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.415457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c449966d-a394-4539-b6a1-bc900c261b33 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.421933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 797/1590] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.422630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d2783-a352-44bf-aeb1-ace39721716c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.430616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 794/1591] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.431675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449966d-a394-4539-b6a1-bc900c261b33 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.436742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905d2783-a352-44bf-aeb1-ace39721716c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.441736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a48d0-993d-44e4-a4ae-c7b16aa229c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.442354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a48d0-993d-44e4-a4ae-c7b16aa229c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.442650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a48d0-993d-44e4-a4ae-c7b16aa229c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.442934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177a48d0-993d-44e4-a4ae-c7b16aa229c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.443539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c449966d-a394-4539-b6a1-bc900c261b33 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.443700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a48d0-993d-44e4-a4ae-c7b16aa229c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.445266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177a48d0-993d-44e4-a4ae-c7b16aa229c2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.449734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e58924-a2ba-488f-be19-7b81c132982d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.450340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e58924-a2ba-488f-be19-7b81c132982d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.450967 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e58924-a2ba-488f-be19-7b81c132982d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.451552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e58924-a2ba-488f-be19-7b81c132982d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.452440 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e58924-a2ba-488f-be19-7b81c132982d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.454168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e58924-a2ba-488f-be19-7b81c132982d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.459179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 798/1592] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.459179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a48d0-993d-44e4-a4ae-c7b16aa229c2 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.468627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177a48d0-993d-44e4-a4ae-c7b16aa229c2 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.474112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 795/1593] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.474112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e58924-a2ba-488f-be19-7b81c132982d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.477300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c8012-0cf5-40af-b89b-00942f029722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.478174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c8012-0cf5-40af-b89b-00942f029722 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.478455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c8012-0cf5-40af-b89b-00942f029722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.478716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c8012-0cf5-40af-b89b-00942f029722 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.479451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c8012-0cf5-40af-b89b-00942f029722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.481116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c8012-0cf5-40af-b89b-00942f029722 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.483450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e58924-a2ba-488f-be19-7b81c132982d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.488682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96949d4-6b66-4fb7-ba67-214f73ada211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.489315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96949d4-6b66-4fb7-ba67-214f73ada211 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.489589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96949d4-6b66-4fb7-ba67-214f73ada211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.489855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96949d4-6b66-4fb7-ba67-214f73ada211 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.490501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96949d4-6b66-4fb7-ba67-214f73ada211 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.492171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96949d4-6b66-4fb7-ba67-214f73ada211 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.493921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 799/1594] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.498045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c8012-0cf5-40af-b89b-00942f029722 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.504250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 796/1595] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.505347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96949d4-6b66-4fb7-ba67-214f73ada211 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.511925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c8012-0cf5-40af-b89b-00942f029722 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.517185 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc3807-9f84-4d13-9c75-2da1a48a7103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.517806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc3807-9f84-4d13-9c75-2da1a48a7103 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.518083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc3807-9f84-4d13-9c75-2da1a48a7103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.518349 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bc3807-9f84-4d13-9c75-2da1a48a7103 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.519372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc3807-9f84-4d13-9c75-2da1a48a7103 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.519504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96949d4-6b66-4fb7-ba67-214f73ada211 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.521016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bc3807-9f84-4d13-9c75-2da1a48a7103 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.525851 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a18d50-6c9d-4bae-8f58-e6c211e705e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.526528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a18d50-6c9d-4bae-8f58-e6c211e705e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.527182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a18d50-6c9d-4bae-8f58-e6c211e705e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.527182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a18d50-6c9d-4bae-8f58-e6c211e705e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.528158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a18d50-6c9d-4bae-8f58-e6c211e705e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.529931 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a18d50-6c9d-4bae-8f58-e6c211e705e7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.532195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 800/1596] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.532876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc3807-9f84-4d13-9c75-2da1a48a7103 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.543303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bc3807-9f84-4d13-9c75-2da1a48a7103 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.547904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 797/1597] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.547904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a18d50-6c9d-4bae-8f58-e6c211e705e7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.556248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e7769-86d4-412f-a1b3-be4f3e7ec7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.557282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e7769-86d4-412f-a1b3-be4f3e7ec7a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.557869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e7769-86d4-412f-a1b3-be4f3e7ec7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.558325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8e7769-86d4-412f-a1b3-be4f3e7ec7a4 admin admin] PATH_INFO: `/v3/projects/09d40643694645c19149559a3e33af0c/users/b9277840830b454c9097109a45d48927/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.558463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a18d50-6c9d-4bae-8f58-e6c211e705e7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.565216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16454a7-4c01-4557-8a65-23536b746559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.566516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16454a7-4c01-4557-8a65-23536b746559 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.566949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16454a7-4c01-4557-8a65-23536b746559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.567309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16454a7-4c01-4557-8a65-23536b746559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.568176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16454a7-4c01-4557-8a65-23536b746559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.570566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16454a7-4c01-4557-8a65-23536b746559 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.583399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 798/1598] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:30.584146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16454a7-4c01-4557-8a65-23536b746559 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.584658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e7769-86d4-412f-a1b3-be4f3e7ec7a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=09d40643694645c19149559a3e33af0c, user_id=b9277840830b454c9097109a45d48927, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.589050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8e7769-86d4-412f-a1b3-be4f3e7ec7a4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.597088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16454a7-4c01-4557-8a65-23536b746559 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.602033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb592ebb-80cd-4c1c-bfa6-d38950ac13f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.603162 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb592ebb-80cd-4c1c-bfa6-d38950ac13f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.603745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb592ebb-80cd-4c1c-bfa6-d38950ac13f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.604131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb592ebb-80cd-4c1c-bfa6-d38950ac13f0 admin admin] PATH_INFO: `/v3/projects/90bd6052ffbd41aaacd42c59ece13607/users/3090b779679b4a69be4f40b7a3a13d65/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.610588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 801/1599] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:30 2022] PUT /identity/v3/projects/09d40643694645c19149559a3e33af0c/users/b9277840830b454c9097109a45d48927/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:30.611441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e7769-86d4-412f-a1b3-be4f3e7ec7a4 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.626059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb592ebb-80cd-4c1c-bfa6-d38950ac13f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90bd6052ffbd41aaacd42c59ece13607, user_id=3090b779679b4a69be4f40b7a3a13d65, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.628897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb592ebb-80cd-4c1c-bfa6-d38950ac13f0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.659031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 799/1600] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:30 2022] PUT /identity/v3/projects/90bd6052ffbd41aaacd42c59ece13607/users/3090b779679b4a69be4f40b7a3a13d65/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:30.659031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb592ebb-80cd-4c1c-bfa6-d38950ac13f0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.699272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8e7769-86d4-412f-a1b3-be4f3e7ec7a4 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.737393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:30.737597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb592ebb-80cd-4c1c-bfa6-d38950ac13f0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.744511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb471-d939-4e34-a6ca-10313c4ba61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.745237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb471-d939-4e34-a6ca-10313c4ba61c admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.745522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb471-d939-4e34-a6ca-10313c4ba61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.745791 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cbb471-d939-4e34-a6ca-10313c4ba61c admin admin] PATH_INFO: `/v3/projects/2270d0529ef1465291051b14fbc2dae6/users/d7514587fb914c48990104851fa8bad0/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.768225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbb471-d939-4e34-a6ca-10313c4ba61c admin admin] RBAC: Authorizing `identity:create_grant(project_id=2270d0529ef1465291051b14fbc2dae6, user_id=d7514587fb914c48990104851fa8bad0, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.775250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cbb471-d939-4e34-a6ca-10313c4ba61c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.783332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b03fe-b054-4f9c-8070-85fd428b4aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.784815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b03fe-b054-4f9c-8070-85fd428b4aae admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.785104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b03fe-b054-4f9c-8070-85fd428b4aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.785380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7b03fe-b054-4f9c-8070-85fd428b4aae admin admin] PATH_INFO: `/v3/projects/8da908123cfa49bcbcf319be2477c5cf/users/f4dc13616b254a2589f0cd2bdf10de40/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.795897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 800/1601] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:30 2022] PUT /identity/v3/projects/2270d0529ef1465291051b14fbc2dae6/users/d7514587fb914c48990104851fa8bad0/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:30.798109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb471-d939-4e34-a6ca-10313c4ba61c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.804937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b03fe-b054-4f9c-8070-85fd428b4aae admin admin] RBAC: Authorizing `identity:create_grant(project_id=8da908123cfa49bcbcf319be2477c5cf, user_id=f4dc13616b254a2589f0cd2bdf10de40, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.807782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7b03fe-b054-4f9c-8070-85fd428b4aae admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.815873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:30.826581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 802/1602] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:30 2022] PUT /identity/v3/projects/8da908123cfa49bcbcf319be2477c5cf/users/f4dc13616b254a2589f0cd2bdf10de40/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:30.837176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b03fe-b054-4f9c-8070-85fd428b4aae admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.875096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cbb471-d939-4e34-a6ca-10313c4ba61c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.913917 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7b03fe-b054-4f9c-8070-85fd428b4aae admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:30.918733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efec49-931e-457a-8cd9-2651fe39a05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.919556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efec49-931e-457a-8cd9-2651fe39a05a admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.920000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efec49-931e-457a-8cd9-2651fe39a05a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.920467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38efec49-931e-457a-8cd9-2651fe39a05a admin admin] PATH_INFO: `/v3/projects/af898a3f188d45c6928575e05ac7c4f1/users/daf927fd6b4a47d494e8c84cdc3eb673/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.935584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efec49-931e-457a-8cd9-2651fe39a05a admin admin] RBAC: Authorizing `identity:create_grant(project_id=af898a3f188d45c6928575e05ac7c4f1, user_id=daf927fd6b4a47d494e8c84cdc3eb673, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.938467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38efec49-931e-457a-8cd9-2651fe39a05a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.939640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86846c23-4491-4538-8402-0a1cd70cfd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:30.940310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86846c23-4491-4538-8402-0a1cd70cfd7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.940587 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86846c23-4491-4538-8402-0a1cd70cfd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.940856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86846c23-4491-4538-8402-0a1cd70cfd7d admin admin] PATH_INFO: `/v3/projects/0286514f9a6c4742894b19e09e986449/users/4921da0a868b4eda96c980f942729350/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:30.966034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 803/1603] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:30 2022] PUT /identity/v3/projects/af898a3f188d45c6928575e05ac7c4f1/users/daf927fd6b4a47d494e8c84cdc3eb673/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:30.966034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efec49-931e-457a-8cd9-2651fe39a05a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:30.970902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86846c23-4491-4538-8402-0a1cd70cfd7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=0286514f9a6c4742894b19e09e986449, user_id=4921da0a868b4eda96c980f942729350, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:30.973920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86846c23-4491-4538-8402-0a1cd70cfd7d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:30.992027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 801/1604] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:30 2022] PUT /identity/v3/projects/0286514f9a6c4742894b19e09e986449/users/4921da0a868b4eda96c980f942729350/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:30.993632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab11d8-f431-4965-b4f4-e79e6fb411c8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:30.993978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab11d8-f431-4965-b4f4-e79e6fb411c8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:30.994313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab11d8-f431-4965-b4f4-e79e6fb411c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.019778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9eab11d8-f431-4965-b4f4-e79e6fb411c8 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:31.021130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9eab11d8-f431-4965-b4f4-e79e6fb411c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:31.050847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38efec49-931e-457a-8cd9-2651fe39a05a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:31.089904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 802/1605] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:31.091076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e38be4-659d-4745-8e0e-afb79f8fbc7f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.091361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e38be4-659d-4745-8e0e-afb79f8fbc7f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.091632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e38be4-659d-4745-8e0e-afb79f8fbc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.116381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:31.128670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-81e38be4-659d-4745-8e0e-afb79f8fbc7f None None] MFA Rules not processed for user `3090b779679b4a69be4f40b7a3a13d65`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:31.130092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-81e38be4-659d-4745-8e0e-afb79f8fbc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:31.149048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3577a1eb-9992-4b26-8905-ae32827ec924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:31.149971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577a1eb-9992-4b26-8905-ae32827ec924 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.150356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577a1eb-9992-4b26-8905-ae32827ec924 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.150702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3577a1eb-9992-4b26-8905-ae32827ec924 admin admin] PATH_INFO: `/v3/projects/1ebf02c9429a4018b1480e3077a967ac/users/b44b18da73814fe78173631173a245c8/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.170493 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577a1eb-9992-4b26-8905-ae32827ec924 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ebf02c9429a4018b1480e3077a967ac, user_id=b44b18da73814fe78173631173a245c8, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:31.172047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:31.174801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3577a1eb-9992-4b26-8905-ae32827ec924 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:31.195036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 804/1606] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:30 2022] PUT /identity/v3/projects/1ebf02c9429a4018b1480e3077a967ac/users/b44b18da73814fe78173631173a245c8/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:31.200358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f8b76-90bf-4063-865b-fac108806fdf None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.200969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f8b76-90bf-4063-865b-fac108806fdf None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.201801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f8b76-90bf-4063-865b-fac108806fdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.231408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-8a7f8b76-90bf-4063-865b-fac108806fdf None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:31.236506 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8a7f8b76-90bf-4063-865b-fac108806fdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:31.244420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 803/1607] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:31.244420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50a4b9-7cea-4cdf-8ed1-3059c7e036c8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.244420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50a4b9-7cea-4cdf-8ed1-3059c7e036c8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.244420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d50a4b9-7cea-4cdf-8ed1-3059c7e036c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.302599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0d50a4b9-7cea-4cdf-8ed1-3059c7e036c8 None None] MFA Rules not processed for user `f4dc13616b254a2589f0cd2bdf10de40`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:31.304586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0d50a4b9-7cea-4cdf-8ed1-3059c7e036c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:31.340879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 805/1608] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:31.342762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee600f7c-0334-4783-82b3-8e3ef625945e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.343053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee600f7c-0334-4783-82b3-8e3ef625945e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.343424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee600f7c-0334-4783-82b3-8e3ef625945e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.378598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ee600f7c-0334-4783-82b3-8e3ef625945e None None] MFA Rules not processed for user `daf927fd6b4a47d494e8c84cdc3eb673`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:31.380550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ee600f7c-0334-4783-82b3-8e3ef625945e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:31.408441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 804/1609] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:31.413960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977abb48-0a3b-4f6b-9c08-343ac64d2f1e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.414247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977abb48-0a3b-4f6b-9c08-343ac64d2f1e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.414646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977abb48-0a3b-4f6b-9c08-343ac64d2f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.451801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-977abb48-0a3b-4f6b-9c08-343ac64d2f1e None None] MFA Rules not processed for user `4921da0a868b4eda96c980f942729350`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:31.453901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-977abb48-0a3b-4f6b-9c08-343ac64d2f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:31.464409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 806/1610] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:31.465456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee600f7c-0334-4783-82b3-8e3ef625945e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:31.528715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 805/1611] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:31.530085 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ef84-0866-4e9a-a4b6-3d65b56595e8 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.530378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ef84-0866-4e9a-a4b6-3d65b56595e8 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.530651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e18ef84-0866-4e9a-a4b6-3d65b56595e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.551462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee600f7c-0334-4783-82b3-8e3ef625945e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:31.551976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9e18ef84-0866-4e9a-a4b6-3d65b56595e8 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:31.553249 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9e18ef84-0866-4e9a-a4b6-3d65b56595e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:31.555622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce37777-658d-4211-a499-0d518466fb72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:31.557257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37777-658d-4211-a499-0d518466fb72 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.557257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37777-658d-4211-a499-0d518466fb72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.557257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce37777-658d-4211-a499-0d518466fb72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.566342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 806/1612] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:31.567878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba971-28b3-46ac-981b-d13cf6173a3a None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.568163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba971-28b3-46ac-981b-d13cf6173a3a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.568489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbba971-28b3-46ac-981b-d13cf6173a3a None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.570071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 807/1613] 10.222.0.59 () {54 vars in 962 bytes} [Thu Aug 18 21:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:31.570796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba971-28b3-46ac-981b-d13cf6173a3a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:31.572614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bbbba971-28b3-46ac-981b-d13cf6173a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:31.582129 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce37777-658d-4211-a499-0d518466fb72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:31.584067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce37777-658d-4211-a499-0d518466fb72 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:31.588686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbba971-28b3-46ac-981b-d13cf6173a3a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:31.592226 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:31.594613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc131d-4737-4db3-b81d-60e768ffe680 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:31.595447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc131d-4737-4db3-b81d-60e768ffe680 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.595735 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc131d-4737-4db3-b81d-60e768ffe680 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.595997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fc131d-4737-4db3-b81d-60e768ffe680 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.602220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 807/1614] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:31.603882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce37777-658d-4211-a499-0d518466fb72 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:31.608928 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc131d-4737-4db3-b81d-60e768ffe680 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:31.610841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fc131d-4737-4db3-b81d-60e768ffe680 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:31.616946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce37777-658d-4211-a499-0d518466fb72 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:31.622134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 808/1615] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:31.623144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc131d-4737-4db3-b81d-60e768ffe680 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:31.634172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fc131d-4737-4db3-b81d-60e768ffe680 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:31.637709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0216d28-2810-44f6-9881-92acd35bea26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:31.639563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0216d28-2810-44f6-9881-92acd35bea26 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.640013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0216d28-2810-44f6-9881-92acd35bea26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.640565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad2ff0-82fd-46c1-90a0-30b41036da40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:31.641250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0216d28-2810-44f6-9881-92acd35bea26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.641749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad2ff0-82fd-46c1-90a0-30b41036da40 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.642056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad2ff0-82fd-46c1-90a0-30b41036da40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.642517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad2ff0-82fd-46c1-90a0-30b41036da40 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.642743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0216d28-2810-44f6-9881-92acd35bea26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:31.643567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad2ff0-82fd-46c1-90a0-30b41036da40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:31.646787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad2ff0-82fd-46c1-90a0-30b41036da40 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:31.650060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0216d28-2810-44f6-9881-92acd35bea26 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:31.691334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 809/1616] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:31.691334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9e55c-53ad-4e98-9657-6ee0c8002fe4 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.691334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9e55c-53ad-4e98-9657-6ee0c8002fe4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.691334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c9e55c-53ad-4e98-9657-6ee0c8002fe4 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.692419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 810/1617] 10.222.0.59 () {54 vars in 962 bytes} [Thu Aug 18 21:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:31.693657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbdf54-15ad-412e-96b5-5f1e52306ebf None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.694071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbdf54-15ad-412e-96b5-5f1e52306ebf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.694380 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fbdf54-15ad-412e-96b5-5f1e52306ebf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.717114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 808/1618] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/projects => generated 403 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:31.718102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0216d28-2810-44f6-9881-92acd35bea26 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:31.721187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:31.765248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-15fbdf54-15ad-412e-96b5-5f1e52306ebf None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:31.766546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-15fbdf54-15ad-412e-96b5-5f1e52306ebf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:31.830449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0216d28-2810-44f6-9881-92acd35bea26 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:31.835675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf293fe1-9c42-4b8a-b4e3-d546b0261737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:31.836505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293fe1-9c42-4b8a-b4e3-d546b0261737 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.836790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293fe1-9c42-4b8a-b4e3-d546b0261737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.837062 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf293fe1-9c42-4b8a-b4e3-d546b0261737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.869655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 811/1619] 10.222.0.59 () {58 vars in 1059 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:31.870617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbdf54-15ad-412e-96b5-5f1e52306ebf None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:31.964512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf293fe1-9c42-4b8a-b4e3-d546b0261737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:31.966001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf293fe1-9c42-4b8a-b4e3-d546b0261737 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:31.966520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fbdf54-15ad-412e-96b5-5f1e52306ebf None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:31.973044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1bf44-972c-4b7a-9891-536dd876c2f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:31.973841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1bf44-972c-4b7a-9891-536dd876c2f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.974126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1bf44-972c-4b7a-9891-536dd876c2f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.974400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d1bf44-972c-4b7a-9891-536dd876c2f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:31.975144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1bf44-972c-4b7a-9891-536dd876c2f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:31.977302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d1bf44-972c-4b7a-9891-536dd876c2f8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:31.990053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 809/1620] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:31.992782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f93283-31c5-483c-9d2e-9a645a041106 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:31.993013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f93283-31c5-483c-9d2e-9a645a041106 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:31.994989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f93283-31c5-483c-9d2e-9a645a041106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.014109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 812/1621] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/users => generated 289 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:32.015164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1bf44-972c-4b7a-9891-536dd876c2f8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.031805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d1bf44-972c-4b7a-9891-536dd876c2f8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.048247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdafbf5-dc74-44f8-a3bb-e163608c853f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.048870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdafbf5-dc74-44f8-a3bb-e163608c853f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.049205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdafbf5-dc74-44f8-a3bb-e163608c853f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.049413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdafbf5-dc74-44f8-a3bb-e163608c853f admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.050051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdafbf5-dc74-44f8-a3bb-e163608c853f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.052024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdafbf5-dc74-44f8-a3bb-e163608c853f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.066567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-82f93283-31c5-483c-9d2e-9a645a041106 None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:32.072174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-82f93283-31c5-483c-9d2e-9a645a041106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:32.104104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 810/1622] 10.222.0.59 () {58 vars in 1059 bytes} [Thu Aug 18 21:05:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:32.106717 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f93283-31c5-483c-9d2e-9a645a041106 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.118670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 813/1623] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:32 2022] POST /identity/v3/users => generated 308 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:32.119755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdafbf5-dc74-44f8-a3bb-e163608c853f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.140153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdafbf5-dc74-44f8-a3bb-e163608c853f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.147812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73e0a2-3509-4d5e-9876-7e7b9e4a5c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.149113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e0a2-3509-4d5e-9876-7e7b9e4a5c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.149563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e0a2-3509-4d5e-9876-7e7b9e4a5c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.150627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73e0a2-3509-4d5e-9876-7e7b9e4a5c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.151767 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73e0a2-3509-4d5e-9876-7e7b9e4a5c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.153406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f93283-31c5-483c-9d2e-9a645a041106 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.155198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d73e0a2-3509-4d5e-9876-7e7b9e4a5c1c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.171429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd59f21-3e8a-461c-9e34-1232e6a84c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.172718 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd59f21-3e8a-461c-9e34-1232e6a84c97 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.173160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd59f21-3e8a-461c-9e34-1232e6a84c97 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.173591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd59f21-3e8a-461c-9e34-1232e6a84c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.187001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 814/1624] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:32.188956 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73e0a2-3509-4d5e-9876-7e7b9e4a5c1c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.207025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73e0a2-3509-4d5e-9876-7e7b9e4a5c1c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.217277 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de41a87-a33f-4ab3-b5d5-76a8d72d1c8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.218267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de41a87-a33f-4ab3-b5d5-76a8d72d1c8c service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.219290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de41a87-a33f-4ab3-b5d5-76a8d72d1c8c service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.219840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de41a87-a33f-4ab3-b5d5-76a8d72d1c8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.292738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:32.299952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd59f21-3e8a-461c-9e34-1232e6a84c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.304832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd59f21-3e8a-461c-9e34-1232e6a84c97 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.309944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de41a87-a33f-4ab3-b5d5-76a8d72d1c8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.312691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de41a87-a33f-4ab3-b5d5-76a8d72d1c8c service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.331712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 815/1625] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:32.333759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de41a87-a33f-4ab3-b5d5-76a8d72d1c8c service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.345782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 811/1626] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:32.347948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd59f21-3e8a-461c-9e34-1232e6a84c97 service nova] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.364316 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de41a87-a33f-4ab3-b5d5-76a8d72d1c8c service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.374366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731b9ea-2eaf-40f6-a4cc-000434c7c565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.375432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731b9ea-2eaf-40f6-a4cc-000434c7c565 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.375892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731b9ea-2eaf-40f6-a4cc-000434c7c565 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.376406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2731b9ea-2eaf-40f6-a4cc-000434c7c565 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.377244 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731b9ea-2eaf-40f6-a4cc-000434c7c565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.379286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2731b9ea-2eaf-40f6-a4cc-000434c7c565 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.387298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd59f21-3e8a-461c-9e34-1232e6a84c97 service nova] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.405537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29f1b-5bb0-4d52-8403-e2f94974cd4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.406185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 816/1627] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:32.408711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29f1b-5bb0-4d52-8403-e2f94974cd4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.411031 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29f1b-5bb0-4d52-8403-e2f94974cd4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.411328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b29f1b-5bb0-4d52-8403-e2f94974cd4b admin admin] PATH_INFO: `/v3/projects/3fc4dc438d9b42bb8d3ac6775059011d/users/4383b32ad6724e43833a5c585854ea4c/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.415837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731b9ea-2eaf-40f6-a4cc-000434c7c565 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.436072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2731b9ea-2eaf-40f6-a4cc-000434c7c565 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.445410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f321b-1993-424d-a7df-68ba3beb780e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.450039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f321b-1993-424d-a7df-68ba3beb780e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.450545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f321b-1993-424d-a7df-68ba3beb780e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.452699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f321b-1993-424d-a7df-68ba3beb780e admin admin] PATH_INFO: `/v3/projects/655431fc93214f238f288a4a0054b171/users/19fe65f33a3b4bfa8033da7c1f609d27/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.511225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b29f1b-5bb0-4d52-8403-e2f94974cd4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc4dc438d9b42bb8d3ac6775059011d, user_id=4383b32ad6724e43833a5c585854ea4c, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.511225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b29f1b-5bb0-4d52-8403-e2f94974cd4b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.511225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:32.538325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 812/1628] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:32 2022] PUT /identity/v3/projects/3fc4dc438d9b42bb8d3ac6775059011d/users/4383b32ad6724e43833a5c585854ea4c/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:32.542818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29f1b-5bb0-4d52-8403-e2f94974cd4b admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.591390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f321b-1993-424d-a7df-68ba3beb780e admin admin] RBAC: Authorizing `identity:create_grant(project_id=655431fc93214f238f288a4a0054b171, user_id=19fe65f33a3b4bfa8033da7c1f609d27, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.611177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004f321b-1993-424d-a7df-68ba3beb780e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.676850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 817/1629] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:32 2022] PUT /identity/v3/projects/655431fc93214f238f288a4a0054b171/users/19fe65f33a3b4bfa8033da7c1f609d27/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:32.679053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f321b-1993-424d-a7df-68ba3beb780e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.783193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b29f1b-5bb0-4d52-8403-e2f94974cd4b admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.861030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f321b-1993-424d-a7df-68ba3beb780e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.874159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797e76a-e634-4dcf-b745-04d537204314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.875104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e76a-e634-4dcf-b745-04d537204314 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.875502 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e76a-e634-4dcf-b745-04d537204314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.875792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5797e76a-e634-4dcf-b745-04d537204314 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.876707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797e76a-e634-4dcf-b745-04d537204314 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.882340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5797e76a-e634-4dcf-b745-04d537204314 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.916801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 818/1630] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:32.921631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797e76a-e634-4dcf-b745-04d537204314 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.945054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25912d67-794a-48f5-9467-a2fd5c157825 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.946309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25912d67-794a-48f5-9467-a2fd5c157825 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.946857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25912d67-794a-48f5-9467-a2fd5c157825 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.947340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25912d67-794a-48f5-9467-a2fd5c157825 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.948326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5797e76a-e634-4dcf-b745-04d537204314 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:32.948540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25912d67-794a-48f5-9467-a2fd5c157825 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.950373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25912d67-794a-48f5-9467-a2fd5c157825 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.962190 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 813/1631] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:32 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:32.965663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6575d3af-0df4-40be-a5c6-58d124e4c890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:32.965663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575d3af-0df4-40be-a5c6-58d124e4c890 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.965663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575d3af-0df4-40be-a5c6-58d124e4c890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.965663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6575d3af-0df4-40be-a5c6-58d124e4c890 admin admin] PATH_INFO: `/v3/projects/655431fc93214f238f288a4a0054b171/users/19fe65f33a3b4bfa8033da7c1f609d27/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.968070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575d3af-0df4-40be-a5c6-58d124e4c890 admin admin] RBAC: Authorizing `identity:create_grant(project_id=655431fc93214f238f288a4a0054b171, user_id=19fe65f33a3b4bfa8033da7c1f609d27, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:32.969451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7edd6-82c5-4717-b0c8-5090b00e98b2 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:32.969946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7edd6-82c5-4717-b0c8-5090b00e98b2 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:32.970434 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7edd6-82c5-4717-b0c8-5090b00e98b2 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:32.972411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 814/1632] 10.222.0.59 () {54 vars in 912 bytes} [Thu Aug 18 21:05:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:32.973435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7edd6-82c5-4717-b0c8-5090b00e98b2 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:32.976427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6575d3af-0df4-40be-a5c6-58d124e4c890 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:32.992378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7edd6-82c5-4717-b0c8-5090b00e98b2 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:33.003052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 819/1633] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:32 2022] PUT /identity/v3/projects/655431fc93214f238f288a4a0054b171/users/19fe65f33a3b4bfa8033da7c1f609d27/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:33.004803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162faf-bf80-41e7-b25a-ffae96312fe2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.006314 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162faf-bf80-41e7-b25a-ffae96312fe2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.007918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e162faf-bf80-41e7-b25a-ffae96312fe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.042848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2e162faf-bf80-41e7-b25a-ffae96312fe2 None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:33.044656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2e162faf-bf80-41e7-b25a-ffae96312fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:33.093582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d2f8f0-9e5d-49d7-845a-50924fe4e36a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:33.094870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f8f0-9e5d-49d7-845a-50924fe4e36a admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.095288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f8f0-9e5d-49d7-845a-50924fe4e36a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.095569 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d2f8f0-9e5d-49d7-845a-50924fe4e36a admin admin] PATH_INFO: `/v3/projects/3fc4dc438d9b42bb8d3ac6775059011d/users/4383b32ad6724e43833a5c585854ea4c/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.097874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2f8f0-9e5d-49d7-845a-50924fe4e36a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3fc4dc438d9b42bb8d3ac6775059011d, user_id=4383b32ad6724e43833a5c585854ea4c, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:33.101055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d2f8f0-9e5d-49d7-845a-50924fe4e36a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:33.122826 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 815/1634] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:32 2022] PUT /identity/v3/projects/3fc4dc438d9b42bb8d3ac6775059011d/users/4383b32ad6724e43833a5c585854ea4c/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:33.122826 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116c9e7-1596-4e4c-82dc-71e0d337e73e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.122826 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116c9e7-1596-4e4c-82dc-71e0d337e73e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.122826 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0116c9e7-1596-4e4c-82dc-71e0d337e73e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.168335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-0116c9e7-1596-4e4c-82dc-71e0d337e73e None None] MFA Rules not processed for user `19fe65f33a3b4bfa8033da7c1f609d27`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:33.170315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0116c9e7-1596-4e4c-82dc-71e0d337e73e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:33.172445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 820/1635] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:33.174608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd300b-a1f1-4c37-a6bb-b327c690afbf None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.175101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd300b-a1f1-4c37-a6bb-b327c690afbf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.175654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dd300b-a1f1-4c37-a6bb-b327c690afbf None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.190714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 821/1636] 10.222.0.59 () {54 vars in 912 bytes} [Thu Aug 18 21:05:33 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:33.193771 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93807-3efb-4955-a645-3c1db8550434 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.194596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93807-3efb-4955-a645-3c1db8550434 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.195097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b93807-3efb-4955-a645-3c1db8550434 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.246144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:33.249940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-08b93807-3efb-4955-a645-3c1db8550434 None None] MFA Rules not processed for user `4383b32ad6724e43833a5c585854ea4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:33.251694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-08b93807-3efb-4955-a645-3c1db8550434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:33.283123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:33.388758 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 822/1637] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:33.390308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b93807-3efb-4955-a645-3c1db8550434 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:33.400275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 816/1638] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:33.401656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35d304-e46e-40e3-ad8b-b8a51ff909de None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.401948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35d304-e46e-40e3-ad8b-b8a51ff909de None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.402218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a35d304-e46e-40e3-ad8b-b8a51ff909de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.449755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-3a35d304-e46e-40e3-ad8b-b8a51ff909de None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:33.451482 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3a35d304-e46e-40e3-ad8b-b8a51ff909de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:33.474515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b93807-3efb-4955-a645-3c1db8550434 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:33.480090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150408a-1735-4c4d-82bf-507ebd0f0eeb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:33.480805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150408a-1735-4c4d-82bf-507ebd0f0eeb service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.481284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150408a-1735-4c4d-82bf-507ebd0f0eeb service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.481624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4150408a-1735-4c4d-82bf-507ebd0f0eeb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.606485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 817/1639] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:05:33 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:33.607439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35d304-e46e-40e3-ad8b-b8a51ff909de None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:33.626937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a35d304-e46e-40e3-ad8b-b8a51ff909de None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:33.630731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b19a-21df-4dd2-8d93-db31aa66f998 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:33.631390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b19a-21df-4dd2-8d93-db31aa66f998 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.631690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b19a-21df-4dd2-8d93-db31aa66f998 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.631950 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99b19a-21df-4dd2-8d93-db31aa66f998 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.632762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150408a-1735-4c4d-82bf-507ebd0f0eeb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:33.634751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4150408a-1735-4c4d-82bf-507ebd0f0eeb service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:33.655393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99b19a-21df-4dd2-8d93-db31aa66f998 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:33.656090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99b19a-21df-4dd2-8d93-db31aa66f998 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:33.664491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 823/1640] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:33.691910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 818/1641] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:33.778158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150408a-1735-4c4d-82bf-507ebd0f0eeb service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:33.798525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4150408a-1735-4c4d-82bf-507ebd0f0eeb service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:33.810565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb4cf-c943-4bda-84a1-eec72e07b956 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:33.812112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb4cf-c943-4bda-84a1-eec72e07b956 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:33.812358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb4cf-c943-4bda-84a1-eec72e07b956 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:33.812753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15cb4cf-c943-4bda-84a1-eec72e07b956 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:33.828573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb4cf-c943-4bda-84a1-eec72e07b956 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:33.830355 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15cb4cf-c943-4bda-84a1-eec72e07b956 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:33.863825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 824/1642] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:33.975945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b19a-21df-4dd2-8d93-db31aa66f998 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:33.991434 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99b19a-21df-4dd2-8d93-db31aa66f998 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:34.001691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c233e6b-29d9-40ac-b3f0-a3dd278a3126 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:34.002502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c233e6b-29d9-40ac-b3f0-a3dd278a3126 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:34.003036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c233e6b-29d9-40ac-b3f0-a3dd278a3126 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:34.003425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c233e6b-29d9-40ac-b3f0-a3dd278a3126 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:34.024827 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c233e6b-29d9-40ac-b3f0-a3dd278a3126 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:34.026601 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c233e6b-29d9-40ac-b3f0-a3dd278a3126 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:34.051006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 819/1643] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:35.036204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb4cf-c943-4bda-84a1-eec72e07b956 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:35.063716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15cb4cf-c943-4bda-84a1-eec72e07b956 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:35.073146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318b1dfb-fa9e-4513-bcaa-486dc209e6fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:35.074278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b1dfb-fa9e-4513-bcaa-486dc209e6fa service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:35.081216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b1dfb-fa9e-4513-bcaa-486dc209e6fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:35.082148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318b1dfb-fa9e-4513-bcaa-486dc209e6fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:35.146935 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:35.209670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b1dfb-fa9e-4513-bcaa-486dc209e6fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:35.211441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318b1dfb-fa9e-4513-bcaa-486dc209e6fa service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:35.232045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 825/1644] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:35.467404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c233e6b-29d9-40ac-b3f0-a3dd278a3126 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:35.597760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c233e6b-29d9-40ac-b3f0-a3dd278a3126 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:35.612248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:35.612918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:35.613198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:35.613471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] PATH_INFO: `/v3/users/f4dc13616b254a2589f0cd2bdf10de40` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:35.623715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4dc13616b254a2589f0cd2bdf10de40)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:35.626550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:35.685433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:35.735802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4dc13616b254a2589f0cd2bdf10de40'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.759339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4dc13616b254a2589f0cd2bdf10de40'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.800419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4dc13616b254a2589f0cd2bdf10de40'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.819695 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4dc13616b254a2589f0cd2bdf10de40'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.820469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4dc13616b254a2589f0cd2bdf10de40'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:35.829965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 820/1645] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:35 2022] DELETE /identity/v3/users/f4dc13616b254a2589f0cd2bdf10de40 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:35.834227 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b516a7-14dc-48b9-a910-85b0ce0340d1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:35.834712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b516a7-14dc-48b9-a910-85b0ce0340d1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:35.835111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b516a7-14dc-48b9-a910-85b0ce0340d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:35.879572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f6b516a7-14dc-48b9-a910-85b0ce0340d1 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:35.884789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f6b516a7-14dc-48b9-a910-85b0ce0340d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:35.980185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 826/1646] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:05:36.026816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:36.028982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:36.157633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078e5ac3-87e0-46fb-8c8b-9c848aa9e4d5 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:36.167162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b75f95-400e-4f27-86d2-7f6dade55794 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:36.168283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75f95-400e-4f27-86d2-7f6dade55794 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:36.168574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75f95-400e-4f27-86d2-7f6dade55794 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:36.168845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b75f95-400e-4f27-86d2-7f6dade55794 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:36.181551 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b75f95-400e-4f27-86d2-7f6dade55794 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:36.183560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b75f95-400e-4f27-86d2-7f6dade55794 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:36.197182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 821/1647] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:37.858417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b516a7-14dc-48b9-a910-85b0ce0340d1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:37.860032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f6b516a7-14dc-48b9-a910-85b0ce0340d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:37.892448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b516a7-14dc-48b9-a910-85b0ce0340d1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:37.914282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:37.915300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:37.917858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:37.918380 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] PATH_INFO: `/v3/projects/8da908123cfa49bcbcf319be2477c5cf` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:37.920746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] RBAC: Authorizing `identity:delete_project(project_id=8da908123cfa49bcbcf319be2477c5cf)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:37.923796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:38.069511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8da908123cfa49bcbcf319be2477c5cf', 'request_id': 'req-134f69ea-14df-4fbe-a65a-41a22827fbca'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.110713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8da908123cfa49bcbcf319be2477c5cf', 'request_id': 'req-134f69ea-14df-4fbe-a65a-41a22827fbca'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.119825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8da908123cfa49bcbcf319be2477c5cf', 'request_id': 'req-134f69ea-14df-4fbe-a65a-41a22827fbca'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.156400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] The token cache is being invalidate because project 8da908123cfa49bcbcf319be2477c5cf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:38.156852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.158494 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.170810 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 827/1648] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:37 2022] DELETE /identity/v3/projects/8da908123cfa49bcbcf319be2477c5cf => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:38.172191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b75f95-400e-4f27-86d2-7f6dade55794 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:38.188678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b75f95-400e-4f27-86d2-7f6dade55794 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:38.376984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:38.377933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:38.378355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:38.378754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] PATH_INFO: `/v3/users/19fe65f33a3b4bfa8033da7c1f609d27` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:38.380249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=19fe65f33a3b4bfa8033da7c1f609d27)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:38.382350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:38.512226 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19fe65f33a3b4bfa8033da7c1f609d27'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.514446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:38.542446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19fe65f33a3b4bfa8033da7c1f609d27'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.560249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19fe65f33a3b4bfa8033da7c1f609d27'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.577663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19fe65f33a3b4bfa8033da7c1f609d27'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.578531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19fe65f33a3b4bfa8033da7c1f609d27'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:38.594162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 822/1649] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:38 2022] DELETE /identity/v3/users/19fe65f33a3b4bfa8033da7c1f609d27 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:05:40.702814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:40.704468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:40.748328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134f69ea-14df-4fbe-a65a-41a22827fbca admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:40.929608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:40.931262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:40.976602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:40.977458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:40.978007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:40.978183 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] PATH_INFO: `/v3/projects/655431fc93214f238f288a4a0054b171` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:40.981534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] RBAC: Authorizing `identity:delete_project(project_id=655431fc93214f238f288a4a0054b171)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:40.984101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:40.992539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:41.127095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2124cc77-c36f-402d-a68a-25269cd44e7c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:41.148998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '655431fc93214f238f288a4a0054b171', 'request_id': 'req-1cc461d0-96d6-4850-a758-273a0ea4d15c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.183257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '655431fc93214f238f288a4a0054b171', 'request_id': 'req-1cc461d0-96d6-4850-a758-273a0ea4d15c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.225301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '655431fc93214f238f288a4a0054b171', 'request_id': 'req-1cc461d0-96d6-4850-a758-273a0ea4d15c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.261597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] The token cache is being invalidate because project 655431fc93214f238f288a4a0054b171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:41.261898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.263171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.270510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 828/1650] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:40 2022] DELETE /identity/v3/projects/655431fc93214f238f288a4a0054b171 => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:41.272312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:41.276109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:41.337677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:41.338559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:41.339052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:41.339474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] PATH_INFO: `/v3/users/daf927fd6b4a47d494e8c84cdc3eb673` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:41.343608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf927fd6b4a47d494e8c84cdc3eb673)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:41.345897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:41.439649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc461d0-96d6-4850-a758-273a0ea4d15c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:41.446908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:41.447859 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:41.448452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:41.449031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] PATH_INFO: `/v3/users/4921da0a868b4eda96c980f942729350` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:41.450451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4921da0a868b4eda96c980f942729350)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:41.452312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: WARNING py.warnings [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:05:41.452312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: warnings.warn(msg) Aug 18 21:05:41.452312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: Aug 18 21:05:41.454563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:41.460803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf927fd6b4a47d494e8c84cdc3eb673'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.499531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf927fd6b4a47d494e8c84cdc3eb673'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.516574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf927fd6b4a47d494e8c84cdc3eb673'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.519882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:41.526524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf927fd6b4a47d494e8c84cdc3eb673'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.527354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-32cc5a57-2b4c-48ad-884b-9fe24ebac145 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf927fd6b4a47d494e8c84cdc3eb673'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.544196 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 823/1651] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:40 2022] DELETE /identity/v3/users/daf927fd6b4a47d494e8c84cdc3eb673 => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:05:41.546193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea81c3b-887d-401c-87a1-c1484b98e744 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:41.546482 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea81c3b-887d-401c-87a1-c1484b98e744 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:41.546756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea81c3b-887d-401c-87a1-c1484b98e744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:41.578029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-cea81c3b-887d-401c-87a1-c1484b98e744 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:41.579570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-cea81c3b-887d-401c-87a1-c1484b98e744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:41.617841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4921da0a868b4eda96c980f942729350'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.618616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4921da0a868b4eda96c980f942729350'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.621476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4921da0a868b4eda96c980f942729350'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.657186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 824/1652] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:41.659450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa96c2-fc52-474c-b14b-c2cce4483e4b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:41.659916 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa96c2-fc52-474c-b14b-c2cce4483e4b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:41.660195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fa96c2-fc52-474c-b14b-c2cce4483e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:41.687387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4921da0a868b4eda96c980f942729350'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.723954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-67fa96c2-fc52-474c-b14b-c2cce4483e4b None None] MFA Rules not processed for user `b44b18da73814fe78173631173a245c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:41.724108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-85e1e4e9-3c75-464c-9f74-b9599beb9c64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4921da0a868b4eda96c980f942729350'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:41.725208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-67fa96c2-fc52-474c-b14b-c2cce4483e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:41.748792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 829/1653] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:41 2022] DELETE /identity/v3/users/4921da0a868b4eda96c980f942729350 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:41.750991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d70eb8-da0e-4c20-8b7b-7a852b6da9b0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:41.751322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d70eb8-da0e-4c20-8b7b-7a852b6da9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:41.751741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d70eb8-da0e-4c20-8b7b-7a852b6da9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:41.775441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d7d70eb8-da0e-4c20-8b7b-7a852b6da9b0 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:41.777814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d7d70eb8-da0e-4c20-8b7b-7a852b6da9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:41.790059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:41.906829 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 825/1654] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:41.908341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca473d6-85cf-4fe3-b4ef-4368ceabc479 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:41.908631 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca473d6-85cf-4fe3-b4ef-4368ceabc479 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:41.908933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca473d6-85cf-4fe3-b4ef-4368ceabc479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:41.921299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 830/1655] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:41.922647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af58e5a-107b-46c2-9092-4c77cf2b15b2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:41.922956 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af58e5a-107b-46c2-9092-4c77cf2b15b2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:41.923230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af58e5a-107b-46c2-9092-4c77cf2b15b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:41.952098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-cca473d6-85cf-4fe3-b4ef-4368ceabc479 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:41.955860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9af58e5a-107b-46c2-9092-4c77cf2b15b2 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:41.956191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-cca473d6-85cf-4fe3-b4ef-4368ceabc479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:41.957259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9af58e5a-107b-46c2-9092-4c77cf2b15b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:41.970198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 831/1656] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:41.972268 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af58e5a-107b-46c2-9092-4c77cf2b15b2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:41.974310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9af58e5a-107b-46c2-9092-4c77cf2b15b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:41.979953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 826/1657] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:41.981505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca473d6-85cf-4fe3-b4ef-4368ceabc479 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:41.985421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-cca473d6-85cf-4fe3-b4ef-4368ceabc479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:42.127602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca473d6-85cf-4fe3-b4ef-4368ceabc479 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:42.135429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb67c4-e3c8-4e21-a024-7df866b8a5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:42.139343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb67c4-e3c8-4e21-a024-7df866b8a5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:42.139343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb67c4-e3c8-4e21-a024-7df866b8a5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:42.139570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cb67c4-e3c8-4e21-a024-7df866b8a5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:42.163633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb67c4-e3c8-4e21-a024-7df866b8a5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:42.165118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cb67c4-e3c8-4e21-a024-7df866b8a5d0 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:42.189694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 827/1658] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:42.191880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb67c4-e3c8-4e21-a024-7df866b8a5d0 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:42.212002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cb67c4-e3c8-4e21-a024-7df866b8a5d0 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:42.223510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c138a-07ae-4f72-8302-fdb0856e8a9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:42.224438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c138a-07ae-4f72-8302-fdb0856e8a9c service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:42.224438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c138a-07ae-4f72-8302-fdb0856e8a9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:42.224687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c138a-07ae-4f72-8302-fdb0856e8a9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:42.225360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af58e5a-107b-46c2-9092-4c77cf2b15b2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:42.240538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3b8d7-35d1-4947-9e5e-b0d9e8c0358e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:42.242553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3b8d7-35d1-4947-9e5e-b0d9e8c0358e service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:42.242553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3b8d7-35d1-4947-9e5e-b0d9e8c0358e service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:42.242553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3b8d7-35d1-4947-9e5e-b0d9e8c0358e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:42.250337 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c138a-07ae-4f72-8302-fdb0856e8a9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:42.253768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c138a-07ae-4f72-8302-fdb0856e8a9c service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:42.294745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 828/1659] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:42.298188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c138a-07ae-4f72-8302-fdb0856e8a9c service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:42.318117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:42.332621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c138a-07ae-4f72-8302-fdb0856e8a9c service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:42.346237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be337a4b-1c0a-4009-a67a-1a633f64a020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:42.347763 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be337a4b-1c0a-4009-a67a-1a633f64a020 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:42.348039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be337a4b-1c0a-4009-a67a-1a633f64a020 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:42.348310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be337a4b-1c0a-4009-a67a-1a633f64a020 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:42.351209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be337a4b-1c0a-4009-a67a-1a633f64a020 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:42.351512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be337a4b-1c0a-4009-a67a-1a633f64a020 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:42.356599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be337a4b-1c0a-4009-a67a-1a633f64a020 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:42.385878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 829/1660] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:42.391755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be337a4b-1c0a-4009-a67a-1a633f64a020 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:42.416276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be337a4b-1c0a-4009-a67a-1a633f64a020 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:42.439596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43049e-dd63-4c41-984b-4147c004f60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:42.439934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3b8d7-35d1-4947-9e5e-b0d9e8c0358e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:42.442303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43049e-dd63-4c41-984b-4147c004f60d admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:42.442939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43049e-dd63-4c41-984b-4147c004f60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:42.443650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f43049e-dd63-4c41-984b-4147c004f60d admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:42.445245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43049e-dd63-4c41-984b-4147c004f60d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:42.446811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3b8d7-35d1-4947-9e5e-b0d9e8c0358e service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:42.449975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f43049e-dd63-4c41-984b-4147c004f60d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:42.476692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 832/1661] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:42.524142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 830/1662] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:42 2022] POST /identity/v3/projects => generated 381 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:42.528633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3b8d7-35d1-4947-9e5e-b0d9e8c0358e service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:42.549272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3b8d7-35d1-4947-9e5e-b0d9e8c0358e service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:42.664900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:42.715382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4c14f-bb4e-496d-8ea8-ba612882815d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:42.716350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4c14f-bb4e-496d-8ea8-ba612882815d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:42.716350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4c14f-bb4e-496d-8ea8-ba612882815d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:42.716580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4c14f-bb4e-496d-8ea8-ba612882815d admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:42.717686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4c14f-bb4e-496d-8ea8-ba612882815d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:42.719878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4c14f-bb4e-496d-8ea8-ba612882815d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:42.783327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 833/1663] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:42 2022] POST /identity/v3/users => generated 291 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:42.787485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43049e-dd63-4c41-984b-4147c004f60d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:42.802466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f43049e-dd63-4c41-984b-4147c004f60d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:42.817082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b379259-6f2a-4f03-9b66-7e9d015b5fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:42.817728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379259-6f2a-4f03-9b66-7e9d015b5fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:42.817998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379259-6f2a-4f03-9b66-7e9d015b5fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:42.818282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b379259-6f2a-4f03-9b66-7e9d015b5fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:42.819103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b379259-6f2a-4f03-9b66-7e9d015b5fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:42.822409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b379259-6f2a-4f03-9b66-7e9d015b5fa4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:42.851712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 831/1664] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:42.853246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4c14f-bb4e-496d-8ea8-ba612882815d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:42.868497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4c14f-bb4e-496d-8ea8-ba612882815d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:42.881182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7c9438-0fcb-4fc2-a412-df99c87c7dbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:42.882959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9438-0fcb-4fc2-a412-df99c87c7dbd admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:42.883403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9438-0fcb-4fc2-a412-df99c87c7dbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:42.884866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7c9438-0fcb-4fc2-a412-df99c87c7dbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:42.885646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c9438-0fcb-4fc2-a412-df99c87c7dbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:42.888932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7c9438-0fcb-4fc2-a412-df99c87c7dbd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:42.931093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 834/1665] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:42 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:42.932961 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b379259-6f2a-4f03-9b66-7e9d015b5fa4 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:42.950250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b379259-6f2a-4f03-9b66-7e9d015b5fa4 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:42.960435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ba941-95d9-4037-94be-651e7a35667e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:42.961145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba941-95d9-4037-94be-651e7a35667e admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:42.961545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba941-95d9-4037-94be-651e7a35667e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:42.961902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3ba941-95d9-4037-94be-651e7a35667e admin admin] PATH_INFO: `/v3/projects/034ce3cfcc1644e595ee74dbfb8798b1/users/300eb6f1cdcd48bf9f66045cfb67acc8/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:43.005720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ba941-95d9-4037-94be-651e7a35667e admin admin] RBAC: Authorizing `identity:create_grant(project_id=034ce3cfcc1644e595ee74dbfb8798b1, user_id=300eb6f1cdcd48bf9f66045cfb67acc8, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:43.015346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3ba941-95d9-4037-94be-651e7a35667e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:43.047685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 832/1666] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:42 2022] PUT /identity/v3/projects/034ce3cfcc1644e595ee74dbfb8798b1/users/300eb6f1cdcd48bf9f66045cfb67acc8/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:43.063372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39820dc3-7e4c-49ba-95ac-6977d64e01e4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:43.063663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39820dc3-7e4c-49ba-95ac-6977d64e01e4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:43.063938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39820dc3-7e4c-49ba-95ac-6977d64e01e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:43.162945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-39820dc3-7e4c-49ba-95ac-6977d64e01e4 None None] MFA Rules not processed for user `300eb6f1cdcd48bf9f66045cfb67acc8`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:43.168307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-39820dc3-7e4c-49ba-95ac-6977d64e01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:43.338811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 835/1667] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:43.343457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ba941-95d9-4037-94be-651e7a35667e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:43.591346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3ba941-95d9-4037-94be-651e7a35667e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:43.597056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e28aaf-3e21-4e50-8c48-162dc3a4ad78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:43.597745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e28aaf-3e21-4e50-8c48-162dc3a4ad78 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:43.597997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e28aaf-3e21-4e50-8c48-162dc3a4ad78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:43.598266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e28aaf-3e21-4e50-8c48-162dc3a4ad78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:43.599090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e28aaf-3e21-4e50-8c48-162dc3a4ad78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:43.601058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e28aaf-3e21-4e50-8c48-162dc3a4ad78 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:43.723449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39820dc3-7e4c-49ba-95ac-6977d64e01e4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:43.730020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-39820dc3-7e4c-49ba-95ac-6977d64e01e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:43.752535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 833/1668] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:43 2022] POST /identity/v3/projects => generated 381 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:43.780663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e28aaf-3e21-4e50-8c48-162dc3a4ad78 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:43.818514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39820dc3-7e4c-49ba-95ac-6977d64e01e4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:43.948346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e28aaf-3e21-4e50-8c48-162dc3a4ad78 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:43.960315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f0aee-387d-468a-b3de-bc484521e1aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:43.961191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f0aee-387d-468a-b3de-bc484521e1aa admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:43.962108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f0aee-387d-468a-b3de-bc484521e1aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:43.962558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f0aee-387d-468a-b3de-bc484521e1aa admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:43.963426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f0aee-387d-468a-b3de-bc484521e1aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:43.966192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28f0aee-387d-468a-b3de-bc484521e1aa admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:44.025549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 834/1669] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:43 2022] POST /identity/v3/users => generated 297 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:44.025549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f0aee-387d-468a-b3de-bc484521e1aa admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:44.028512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f28f0aee-387d-468a-b3de-bc484521e1aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:44.035068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:44.036670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:44.038468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:44.040573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] PATH_INFO: `/v3/users/3090b779679b4a69be4f40b7a3a13d65` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:44.043043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3090b779679b4a69be4f40b7a3a13d65)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:44.047326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:44.061190 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28f0aee-387d-468a-b3de-bc484521e1aa admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:44.073893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:44.075125 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:44.075739 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:44.076402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] PATH_INFO: `/v3/projects/af898a3f188d45c6928575e05ac7c4f1` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:44.078286 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=af898a3f188d45c6928575e05ac7c4f1)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:44.079720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: WARNING py.warnings [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 18 21:05:44.079720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: warnings.warn(msg) Aug 18 21:05:44.079720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: Aug 18 21:05:44.082149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:44.086731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:44.151045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3090b779679b4a69be4f40b7a3a13d65'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.151928 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3090b779679b4a69be4f40b7a3a13d65'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.152817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3090b779679b4a69be4f40b7a3a13d65'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.160973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:44.178630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3090b779679b4a69be4f40b7a3a13d65'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.207104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3090b779679b4a69be4f40b7a3a13d65'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.227877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 836/1670] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:43 2022] DELETE /identity/v3/users/3090b779679b4a69be4f40b7a3a13d65 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:44.227877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:44.230982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:44.231586 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af898a3f188d45c6928575e05ac7c4f1', 'request_id': 'req-b0278272-0725-4260-852f-3447925dc7ee'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.241874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af898a3f188d45c6928575e05ac7c4f1', 'request_id': 'req-b0278272-0725-4260-852f-3447925dc7ee'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.254937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af898a3f188d45c6928575e05ac7c4f1', 'request_id': 'req-b0278272-0725-4260-852f-3447925dc7ee'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.315623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] The token cache is being invalidate because project af898a3f188d45c6928575e05ac7c4f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:44.316189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.317643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.319853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 835/1671] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:44 2022] DELETE /identity/v3/projects/af898a3f188d45c6928575e05ac7c4f1 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:44.321080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:44.322927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:44.393497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12370de5-c374-4154-8f3a-cf65ffe169e7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:44.401189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9786c3a-5b97-47f5-9314-a825a5f264d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:44.401817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9786c3a-5b97-47f5-9314-a825a5f264d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:44.402153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9786c3a-5b97-47f5-9314-a825a5f264d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:44.402356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9786c3a-5b97-47f5-9314-a825a5f264d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:44.403078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9786c3a-5b97-47f5-9314-a825a5f264d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:44.405787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9786c3a-5b97-47f5-9314-a825a5f264d5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:44.433565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 837/1672] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:44.442745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ece9e-6893-47ab-94a9-ed3b3ee8e9a5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:44.443112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ece9e-6893-47ab-94a9-ed3b3ee8e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:44.449570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ece9e-6893-47ab-94a9-ed3b3ee8e9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:44.486151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0278272-0725-4260-852f-3447925dc7ee admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:44.489077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d20ece9e-6893-47ab-94a9-ed3b3ee8e9a5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:44.492352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d20ece9e-6893-47ab-94a9-ed3b3ee8e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:44.499637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:44.500555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:44.500659 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:44.501012 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] PATH_INFO: `/v3/projects/0286514f9a6c4742894b19e09e986449` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:44.502272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=0286514f9a6c4742894b19e09e986449)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:44.504650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:44.512897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 838/1673] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:44.514491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ece9e-6893-47ab-94a9-ed3b3ee8e9a5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:44.521075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d20ece9e-6893-47ab-94a9-ed3b3ee8e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:44.548534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ece9e-6893-47ab-94a9-ed3b3ee8e9a5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:44.562667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:44.563423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:44.564261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:44.564261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] PATH_INFO: `/v3/users/4383b32ad6724e43833a5c585854ea4c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:44.565705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4383b32ad6724e43833a5c585854ea4c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:44.569410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:44.636056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0286514f9a6c4742894b19e09e986449', 'request_id': 'req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.656662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0286514f9a6c4742894b19e09e986449', 'request_id': 'req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.683458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0286514f9a6c4742894b19e09e986449', 'request_id': 'req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.689426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4383b32ad6724e43833a5c585854ea4c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.691160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4383b32ad6724e43833a5c585854ea4c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.692971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4383b32ad6724e43833a5c585854ea4c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.731290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4383b32ad6724e43833a5c585854ea4c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.736681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] The token cache is being invalidate because project 0286514f9a6c4742894b19e09e986449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:44.737048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.739758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.742411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 836/1674] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:44 2022] DELETE /identity/v3/projects/0286514f9a6c4742894b19e09e986449 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:44.744235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:44.747678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:44.765256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4383b32ad6724e43833a5c585854ea4c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:44.802672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:44.850362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 839/1675] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:44 2022] DELETE /identity/v3/users/4383b32ad6724e43833a5c585854ea4c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:44.851075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:44.855512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:44.930629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de02562-5b95-4a46-9cc2-d0e5cd1d1d5c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:44.974429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:45.066893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c90326d-68e8-475a-9337-06ba37520c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:45.067611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90326d-68e8-475a-9337-06ba37520c47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.067896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90326d-68e8-475a-9337-06ba37520c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.068264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c90326d-68e8-475a-9337-06ba37520c47 admin admin] PATH_INFO: `/v3/projects/ac1fb63bb9584d329031c29db9a7179d/users/72eb1e045ca14b48aa40411bd044c8b8/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.111954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48868d2-606c-4ef8-9bb0-166fa2993a30 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:45.140710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f356659-3d77-437e-8ad2-99c1329111b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:45.143456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f356659-3d77-437e-8ad2-99c1329111b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.143737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f356659-3d77-437e-8ad2-99c1329111b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.148373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f356659-3d77-437e-8ad2-99c1329111b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.156805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90326d-68e8-475a-9337-06ba37520c47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1fb63bb9584d329031c29db9a7179d, user_id=72eb1e045ca14b48aa40411bd044c8b8, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:45.158255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5f356659-3d77-437e-8ad2-99c1329111b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:45.165845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c90326d-68e8-475a-9337-06ba37520c47 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:45.210715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 837/1676] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:44 2022] PUT /identity/v3/projects/ac1fb63bb9584d329031c29db9a7179d/users/72eb1e045ca14b48aa40411bd044c8b8/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:45.213192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f356659-3d77-437e-8ad2-99c1329111b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:45.214551 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef346f-195a-4a43-8372-cb1a47d6ec93 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.215580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f356659-3d77-437e-8ad2-99c1329111b5 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:45.216100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef346f-195a-4a43-8372-cb1a47d6ec93 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.216602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ef346f-195a-4a43-8372-cb1a47d6ec93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.255981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 840/1677] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:45.259474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11362b97-266e-4868-9a71-ae6288790fca None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.259757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11362b97-266e-4868-9a71-ae6288790fca None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.260029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11362b97-266e-4868-9a71-ae6288790fca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.306251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d4ef346f-195a-4a43-8372-cb1a47d6ec93 None None] MFA Rules not processed for user `dda19c20bfec49b8b9e1d589f7e3e188`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:45.311350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d4ef346f-195a-4a43-8372-cb1a47d6ec93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:45.319887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-11362b97-266e-4868-9a71-ae6288790fca None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:45.321146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-11362b97-266e-4868-9a71-ae6288790fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:45.495990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 838/1678] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:45.496977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef346f-195a-4a43-8372-cb1a47d6ec93 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:45.584380 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 841/1679] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:45.589385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11362b97-266e-4868-9a71-ae6288790fca None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:45.593343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-11362b97-266e-4868-9a71-ae6288790fca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:45.651296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:45.737791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ef346f-195a-4a43-8372-cb1a47d6ec93 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:45.746321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5085cf9-2f85-4bbc-b82a-d475c780ed03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:45.747439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085cf9-2f85-4bbc-b82a-d475c780ed03 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.748169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085cf9-2f85-4bbc-b82a-d475c780ed03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.749276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5085cf9-2f85-4bbc-b82a-d475c780ed03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.750132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5085cf9-2f85-4bbc-b82a-d475c780ed03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:45.754121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5085cf9-2f85-4bbc-b82a-d475c780ed03 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:45.780542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 839/1680] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:45 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:45.784049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25771ea-15b5-4502-a833-d7c092382c2a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.784580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25771ea-15b5-4502-a833-d7c092382c2a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.785166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25771ea-15b5-4502-a833-d7c092382c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.834685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-f25771ea-15b5-4502-a833-d7c092382c2a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:45.836581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f25771ea-15b5-4502-a833-d7c092382c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:45.857481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 840/1681] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:45.871892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25771ea-15b5-4502-a833-d7c092382c2a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:45.880891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11362b97-266e-4868-9a71-ae6288790fca None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:45.892653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25771ea-15b5-4502-a833-d7c092382c2a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:45.898377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc61e74-00ef-4eb0-93f2-c1ba8fb3cb51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:45.899299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0681e8b5-4cca-4ad0-acf0-6ba658631dd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:45.899711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc61e74-00ef-4eb0-93f2-c1ba8fb3cb51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.900022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc61e74-00ef-4eb0-93f2-c1ba8fb3cb51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.900396 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc61e74-00ef-4eb0-93f2-c1ba8fb3cb51 admin admin] PATH_INFO: `/v3/projects/ac1fb63bb9584d329031c29db9a7179d/users/72eb1e045ca14b48aa40411bd044c8b8/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.902908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681e8b5-4cca-4ad0-acf0-6ba658631dd8 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.903364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681e8b5-4cca-4ad0-acf0-6ba658631dd8 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.904400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc61e74-00ef-4eb0-93f2-c1ba8fb3cb51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac1fb63bb9584d329031c29db9a7179d, user_id=72eb1e045ca14b48aa40411bd044c8b8, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:45.904868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0681e8b5-4cca-4ad0-acf0-6ba658631dd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:45.907743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc61e74-00ef-4eb0-93f2-c1ba8fb3cb51 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:45.927009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681e8b5-4cca-4ad0-acf0-6ba658631dd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:45.932211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0681e8b5-4cca-4ad0-acf0-6ba658631dd8 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:45.943871 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 841/1682] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:45 2022] PUT /identity/v3/projects/ac1fb63bb9584d329031c29db9a7179d/users/72eb1e045ca14b48aa40411bd044c8b8/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:45.953243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc61e74-00ef-4eb0-93f2-c1ba8fb3cb51 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:45.972618 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 842/1683] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:45.975468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30de8-55a4-4e1a-bc5f-cb1ee247cb93 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:45.975757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30de8-55a4-4e1a-bc5f-cb1ee247cb93 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:45.976028 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f30de8-55a4-4e1a-bc5f-cb1ee247cb93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.063848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-20f30de8-55a4-4e1a-bc5f-cb1ee247cb93 None None] MFA Rules not processed for user `72eb1e045ca14b48aa40411bd044c8b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:46.065779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-20f30de8-55a4-4e1a-bc5f-cb1ee247cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:46.129207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc61e74-00ef-4eb0-93f2-c1ba8fb3cb51 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:46.140913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ce2ed-c460-43b4-8e3e-d3f02715f279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:46.141671 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ce2ed-c460-43b4-8e3e-d3f02715f279 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.142011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ce2ed-c460-43b4-8e3e-d3f02715f279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.142356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ce2ed-c460-43b4-8e3e-d3f02715f279 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.143536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ce2ed-c460-43b4-8e3e-d3f02715f279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:46.144549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ce2ed-c460-43b4-8e3e-d3f02715f279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:46.148885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ce2ed-c460-43b4-8e3e-d3f02715f279 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:46.177192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 842/1684] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:46.181618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ce2ed-c460-43b4-8e3e-d3f02715f279 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:46.201415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ce2ed-c460-43b4-8e3e-d3f02715f279 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:46.211654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a69e8-7f60-4621-a69c-07143f9f5971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:46.213417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a69e8-7f60-4621-a69c-07143f9f5971 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.213753 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a69e8-7f60-4621-a69c-07143f9f5971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.214118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322a69e8-7f60-4621-a69c-07143f9f5971 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.215919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a69e8-7f60-4621-a69c-07143f9f5971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:46.218476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:46.221344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322a69e8-7f60-4621-a69c-07143f9f5971 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:46.290825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 843/1685] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:46 2022] POST /identity/v3/projects => generated 365 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:05:46.291914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a69e8-7f60-4621-a69c-07143f9f5971 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:46.297406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 843/1686] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:46.309210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30de8-55a4-4e1a-bc5f-cb1ee247cb93 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:46.310947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-20f30de8-55a4-4e1a-bc5f-cb1ee247cb93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:46.425229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322a69e8-7f60-4621-a69c-07143f9f5971 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:46.437773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852091da-ef5c-4ea6-a2ca-7ba57193efbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:46.438680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852091da-ef5c-4ea6-a2ca-7ba57193efbd admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.440099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852091da-ef5c-4ea6-a2ca-7ba57193efbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.440689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852091da-ef5c-4ea6-a2ca-7ba57193efbd admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.442884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852091da-ef5c-4ea6-a2ca-7ba57193efbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:46.446732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852091da-ef5c-4ea6-a2ca-7ba57193efbd admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:46.469923 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f30de8-55a4-4e1a-bc5f-cb1ee247cb93 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:46.494072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 844/1687] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:46 2022] POST /identity/v3/users => generated 283 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:46.503908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852091da-ef5c-4ea6-a2ca-7ba57193efbd admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:46.533916 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852091da-ef5c-4ea6-a2ca-7ba57193efbd admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:46.540053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c5bbb-2283-46b0-8b8e-a4a2d5dd0d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:46.540734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c5bbb-2283-46b0-8b8e-a4a2d5dd0d8e admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.541014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c5bbb-2283-46b0-8b8e-a4a2d5dd0d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.541422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420c5bbb-2283-46b0-8b8e-a4a2d5dd0d8e admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.542132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c5bbb-2283-46b0-8b8e-a4a2d5dd0d8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:46.543840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420c5bbb-2283-46b0-8b8e-a4a2d5dd0d8e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:46.568047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 845/1688] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:46.572253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c5bbb-2283-46b0-8b8e-a4a2d5dd0d8e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:46.596929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420c5bbb-2283-46b0-8b8e-a4a2d5dd0d8e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:46.597160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3020ee-f881-4467-acb5-eb516c47adc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:46.598133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3020ee-f881-4467-acb5-eb516c47adc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.598616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3020ee-f881-4467-acb5-eb516c47adc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.599803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3020ee-f881-4467-acb5-eb516c47adc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.609027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62a8a-5724-4ea1-b8d5-b43f4155c316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:46.609682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62a8a-5724-4ea1-b8d5-b43f4155c316 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.612682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62a8a-5724-4ea1-b8d5-b43f4155c316 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.612682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c62a8a-5724-4ea1-b8d5-b43f4155c316 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.614089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c62a8a-5724-4ea1-b8d5-b43f4155c316 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:46.618951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c62a8a-5724-4ea1-b8d5-b43f4155c316 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:46.625920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:46.651572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 846/1689] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:46 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:46.653075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62a8a-5724-4ea1-b8d5-b43f4155c316 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:46.676130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c62a8a-5724-4ea1-b8d5-b43f4155c316 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:46.687938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48674ee-fecf-4a14-ad5e-1af9178a41ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:46.689152 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48674ee-fecf-4a14-ad5e-1af9178a41ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.689454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48674ee-fecf-4a14-ad5e-1af9178a41ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.689705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48674ee-fecf-4a14-ad5e-1af9178a41ee admin admin] PATH_INFO: `/v3/projects/7478aeb00ce144259a8d1772315aaf9b/users/7298befd82974e99ad424528c3a03106/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.729359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48674ee-fecf-4a14-ad5e-1af9178a41ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=7478aeb00ce144259a8d1772315aaf9b, user_id=7298befd82974e99ad424528c3a03106, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:46.733519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48674ee-fecf-4a14-ad5e-1af9178a41ee admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:46.745714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3020ee-f881-4467-acb5-eb516c47adc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:46.752232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3020ee-f881-4467-acb5-eb516c47adc3 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:46.766809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 847/1690] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:46 2022] PUT /identity/v3/projects/7478aeb00ce144259a8d1772315aaf9b/users/7298befd82974e99ad424528c3a03106/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:46.778193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061a02-c5a5-46e8-a0dc-fe5590496295 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:46.778193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061a02-c5a5-46e8-a0dc-fe5590496295 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:46.778356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa061a02-c5a5-46e8-a0dc-fe5590496295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:46.781505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 844/1691] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:46 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:05:46.798395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3020ee-f881-4467-acb5-eb516c47adc3 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:46.805659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0d3020ee-f881-4467-acb5-eb516c47adc3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:46.874665 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3020ee-f881-4467-acb5-eb516c47adc3 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:46.901175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-aa061a02-c5a5-46e8-a0dc-fe5590496295 None None] MFA Rules not processed for user `7298befd82974e99ad424528c3a03106`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:46.902541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-aa061a02-c5a5-46e8-a0dc-fe5590496295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:47.052491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:47.075255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 848/1692] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 293 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:47.075255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061a02-c5a5-46e8-a0dc-fe5590496295 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:47.080038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:47.080829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:47.081202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:47.081782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] PATH_INFO: `/v3/projects/90bd6052ffbd41aaacd42c59ece13607` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:47.083453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90bd6052ffbd41aaacd42c59ece13607)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:47.085619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:47.210483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90bd6052ffbd41aaacd42c59ece13607', 'request_id': 'req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:47.234234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90bd6052ffbd41aaacd42c59ece13607', 'request_id': 'req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:47.242332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90bd6052ffbd41aaacd42c59ece13607', 'request_id': 'req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:47.243848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa061a02-c5a5-46e8-a0dc-fe5590496295 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:47.267317 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] The token cache is being invalidate because project 90bd6052ffbd41aaacd42c59ece13607 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:47.267661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:47.268440 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:47.270707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 845/1693] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:46 2022] DELETE /identity/v3/projects/90bd6052ffbd41aaacd42c59ece13607 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:47.271604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:47.280117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:47.315768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46896bc-f1ec-4916-a259-2a8471dc5036 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:47.316392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46896bc-f1ec-4916-a259-2a8471dc5036 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:47.316667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46896bc-f1ec-4916-a259-2a8471dc5036 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:47.316980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46896bc-f1ec-4916-a259-2a8471dc5036 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:47.319177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c46896bc-f1ec-4916-a259-2a8471dc5036 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:47.395683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:47.417689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b8d744-d3c8-4f23-be0e-88d0cdb3c537 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:47.421953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f17c3-f9af-4447-8e87-901347cf0951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:47.422816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f17c3-f9af-4447-8e87-901347cf0951 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:47.423196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f17c3-f9af-4447-8e87-901347cf0951 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:47.423562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354f17c3-f9af-4447-8e87-901347cf0951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:47.426552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-354f17c3-f9af-4447-8e87-901347cf0951 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:47.439909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46896bc-f1ec-4916-a259-2a8471dc5036 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:47.441520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46896bc-f1ec-4916-a259-2a8471dc5036 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:47.456778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 849/1694] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:47.459331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f161-1668-4313-9d00-d2c27e6728b9 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:47.459630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f161-1668-4313-9d00-d2c27e6728b9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:47.459968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3f161-1668-4313-9d00-d2c27e6728b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:47.499972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7ce3f161-1668-4313-9d00-d2c27e6728b9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:47.501254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7ce3f161-1668-4313-9d00-d2c27e6728b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:47.586658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f17c3-f9af-4447-8e87-901347cf0951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:47.590902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354f17c3-f9af-4447-8e87-901347cf0951 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:47.623745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 846/1695] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:47 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:47.682820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f17c3-f9af-4447-8e87-901347cf0951 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:47.684287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-354f17c3-f9af-4447-8e87-901347cf0951 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:47.747306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 850/1696] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:47.759198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5d389-6818-4cdf-b7b1-09c33e9355d0 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:47.759488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5d389-6818-4cdf-b7b1-09c33e9355d0 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:47.759902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f5d389-6818-4cdf-b7b1-09c33e9355d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:47.790182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-20f5d389-6818-4cdf-b7b1-09c33e9355d0 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:47.791612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-20f5d389-6818-4cdf-b7b1-09c33e9355d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:47.804844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 851/1697] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:47.805949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5d389-6818-4cdf-b7b1-09c33e9355d0 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:47.819012 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f5d389-6818-4cdf-b7b1-09c33e9355d0 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:47.826279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91c756-414d-4220-b337-a1df02e16051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:47.827543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91c756-414d-4220-b337-a1df02e16051 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:47.828060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91c756-414d-4220-b337-a1df02e16051 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:47.828706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91c756-414d-4220-b337-a1df02e16051 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:47.829463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91c756-414d-4220-b337-a1df02e16051 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:47.829970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91c756-414d-4220-b337-a1df02e16051 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:47.831876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91c756-414d-4220-b337-a1df02e16051 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:47.854655 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 852/1698] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:47.859697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91c756-414d-4220-b337-a1df02e16051 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:47.881137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91c756-414d-4220-b337-a1df02e16051 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:47.893672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:47.895679 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ef36d-73cd-4702-bb6e-9e01d3e0aa6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:47.906249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef36d-73cd-4702-bb6e-9e01d3e0aa6c admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:47.906753 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef36d-73cd-4702-bb6e-9e01d3e0aa6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:47.916624 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238ef36d-73cd-4702-bb6e-9e01d3e0aa6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:47.917547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ef36d-73cd-4702-bb6e-9e01d3e0aa6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:47.919803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238ef36d-73cd-4702-bb6e-9e01d3e0aa6c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:47.980600 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 853/1699] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:47 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:47.981820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ef36d-73cd-4702-bb6e-9e01d3e0aa6c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:48.041875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354f17c3-f9af-4447-8e87-901347cf0951 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:48.110515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238ef36d-73cd-4702-bb6e-9e01d3e0aa6c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:48.133069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762142-f8bc-49db-9701-ca84361e4504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:48.134144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762142-f8bc-49db-9701-ca84361e4504 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.135139 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762142-f8bc-49db-9701-ca84361e4504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.136474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da762142-f8bc-49db-9701-ca84361e4504 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.137640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da762142-f8bc-49db-9701-ca84361e4504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:48.141091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da762142-f8bc-49db-9701-ca84361e4504 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:48.187301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 854/1700] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:47 2022] POST /identity/v3/users => generated 286 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:48.189491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762142-f8bc-49db-9701-ca84361e4504 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:48.212592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da762142-f8bc-49db-9701-ca84361e4504 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:48.222308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebf38b-d548-42b8-8938-9a88ee8398a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:48.223259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf38b-d548-42b8-8938-9a88ee8398a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.224166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf38b-d548-42b8-8938-9a88ee8398a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.224166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebf38b-d548-42b8-8938-9a88ee8398a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.225324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebf38b-d548-42b8-8938-9a88ee8398a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:48.228822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebf38b-d548-42b8-8938-9a88ee8398a9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:48.251236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:48.251859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 855/1701] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:48.252816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebf38b-d548-42b8-8938-9a88ee8398a9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:48.253098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.253830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.254335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] PATH_INFO: `/v3/projects/3fc4dc438d9b42bb8d3ac6775059011d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.263464 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3fc4dc438d9b42bb8d3ac6775059011d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:48.268359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:48.272698 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebf38b-d548-42b8-8938-9a88ee8398a9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:48.280834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11870f4e-a8c1-4c0f-9c45-051ccd103964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:48.283619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870f4e-a8c1-4c0f-9c45-051ccd103964 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.284051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870f4e-a8c1-4c0f-9c45-051ccd103964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.284968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11870f4e-a8c1-4c0f-9c45-051ccd103964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.285890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11870f4e-a8c1-4c0f-9c45-051ccd103964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:48.291294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11870f4e-a8c1-4c0f-9c45-051ccd103964 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:48.355293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:48.375119 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 856/1702] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:48 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:48.396348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3cd9b-f6f4-4faa-b504-d694bc846412 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.396670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3cd9b-f6f4-4faa-b504-d694bc846412 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.396972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d3cd9b-f6f4-4faa-b504-d694bc846412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.456147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3fc4dc438d9b42bb8d3ac6775059011d', 'request_id': 'req-45102d92-2cc4-4578-8557-65aa9e4f4f1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:48.492339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3fc4dc438d9b42bb8d3ac6775059011d', 'request_id': 'req-45102d92-2cc4-4578-8557-65aa9e4f4f1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:48.516356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3fc4dc438d9b42bb8d3ac6775059011d', 'request_id': 'req-45102d92-2cc4-4578-8557-65aa9e4f4f1a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:48.540200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-11d3cd9b-f6f4-4faa-b504-d694bc846412 None None] MFA Rules not processed for user `d7514587fb914c48990104851fa8bad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:48.540389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-11d3cd9b-f6f4-4faa-b504-d694bc846412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:48.567943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] The token cache is being invalidate because project 3fc4dc438d9b42bb8d3ac6775059011d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:48.568286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:48.577289 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:48.582470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 847/1703] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:47 2022] DELETE /identity/v3/projects/3fc4dc438d9b42bb8d3ac6775059011d => generated 0 bytes in 900 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:48.583427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:48.587437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:48.765046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 857/1704] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 389 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:48.766479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c6479-4001-4dec-8dd9-4ce76cc3abf7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.766800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c6479-4001-4dec-8dd9-4ce76cc3abf7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.774523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831c6479-4001-4dec-8dd9-4ce76cc3abf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:48.846604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-831c6479-4001-4dec-8dd9-4ce76cc3abf7 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:48.848055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-831c6479-4001-4dec-8dd9-4ce76cc3abf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:48.959644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45102d92-2cc4-4578-8557-65aa9e4f4f1a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:48.984900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e199e3-d4eb-40f6-9e5d-9dfad7e3c97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:48.985596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e199e3-d4eb-40f6-9e5d-9dfad7e3c97f admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:48.985877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e199e3-d4eb-40f6-9e5d-9dfad7e3c97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:48.986334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e199e3-d4eb-40f6-9e5d-9dfad7e3c97f admin admin] PATH_INFO: `/v3/projects/0a4d1645413a4f839a50224d31f58e21/users/a6ec317f9ac5429289a949264ce1d780/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.027797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e199e3-d4eb-40f6-9e5d-9dfad7e3c97f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a4d1645413a4f839a50224d31f58e21, user_id=a6ec317f9ac5429289a949264ce1d780, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:49.031084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e199e3-d4eb-40f6-9e5d-9dfad7e3c97f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:49.040670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:49.059369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 858/1705] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:49.059369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f576-0926-42fa-a18b-92fd77116af8 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.059369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f576-0926-42fa-a18b-92fd77116af8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.059369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff6f576-0926-42fa-a18b-92fd77116af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.079866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 848/1706] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:48 2022] PUT /identity/v3/projects/0a4d1645413a4f839a50224d31f58e21/users/a6ec317f9ac5429289a949264ce1d780/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:49.081686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11263ab6-a228-4dca-9684-36ebc5c6e377 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.082000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11263ab6-a228-4dca-9684-36ebc5c6e377 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.083199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11263ab6-a228-4dca-9684-36ebc5c6e377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.114391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-5ff6f576-0926-42fa-a18b-92fd77116af8 None None] MFA Rules not processed for user `d7514587fb914c48990104851fa8bad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:49.120851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5ff6f576-0926-42fa-a18b-92fd77116af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:49.170525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-11263ab6-a228-4dca-9684-36ebc5c6e377 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:49.171962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-11263ab6-a228-4dca-9684-36ebc5c6e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:49.302133 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 859/1707] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:49.302718 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd040700-aa34-4991-afee-b854841016f1 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.310346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd040700-aa34-4991-afee-b854841016f1 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.311497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd040700-aa34-4991-afee-b854841016f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.392243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-fd040700-aa34-4991-afee-b854841016f1 None None] MFA Rules not processed for user `a6ec317f9ac5429289a949264ce1d780`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:49.402167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-fd040700-aa34-4991-afee-b854841016f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:49.414444 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 849/1708] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:49.415497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11263ab6-a228-4dca-9684-36ebc5c6e377 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:49.418145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-11263ab6-a228-4dca-9684-36ebc5c6e377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:49.479365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:49.626957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 860/1709] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:49.627868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd040700-aa34-4991-afee-b854841016f1 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:49.670304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd040700-aa34-4991-afee-b854841016f1 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:49.671894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11263ab6-a228-4dca-9684-36ebc5c6e377 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:49.689062 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120ac16-22d5-4dc6-bcbb-586fa1a62d01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:49.690306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120ac16-22d5-4dc6-bcbb-586fa1a62d01 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.690629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120ac16-22d5-4dc6-bcbb-586fa1a62d01 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.690957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120ac16-22d5-4dc6-bcbb-586fa1a62d01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.691638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a579d-eb86-49a3-9fbb-1501b7266296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:49.692511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a579d-eb86-49a3-9fbb-1501b7266296 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.694864 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a579d-eb86-49a3-9fbb-1501b7266296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.696042 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a579d-eb86-49a3-9fbb-1501b7266296 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.704903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a579d-eb86-49a3-9fbb-1501b7266296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:49.707149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a579d-eb86-49a3-9fbb-1501b7266296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:49.708241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120ac16-22d5-4dc6-bcbb-586fa1a62d01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:49.709884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120ac16-22d5-4dc6-bcbb-586fa1a62d01 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:49.714348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a579d-eb86-49a3-9fbb-1501b7266296 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:49.737094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 850/1710] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:49.737723 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120ac16-22d5-4dc6-bcbb-586fa1a62d01 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:49.752793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 861/1711] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:49.752793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096493d-f398-4209-a24f-55804571a638 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.752793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096493d-f398-4209-a24f-55804571a638 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.752793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b096493d-f398-4209-a24f-55804571a638 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.803885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-b096493d-f398-4209-a24f-55804571a638 None None] MFA Rules not processed for user `b44b18da73814fe78173631173a245c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:49.805791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b096493d-f398-4209-a24f-55804571a638 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:49.811090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120ac16-22d5-4dc6-bcbb-586fa1a62d01 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:49.849350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c526e-4964-4655-81d3-076a3fc17bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:49.851088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c526e-4964-4655-81d3-076a3fc17bcc admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:49.852009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c526e-4964-4655-81d3-076a3fc17bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:49.852956 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0c526e-4964-4655-81d3-076a3fc17bcc admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:49.854206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c526e-4964-4655-81d3-076a3fc17bcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:49.863015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0c526e-4964-4655-81d3-076a3fc17bcc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:49.983003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 862/1712] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:49.984251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096493d-f398-4209-a24f-55804571a638 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:50.000644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 851/1713] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:49 2022] POST /identity/v3/projects => generated 371 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:50.004915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c526e-4964-4655-81d3-076a3fc17bcc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:50.005401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b096493d-f398-4209-a24f-55804571a638 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:50.142931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9b78d-3ece-420d-97c6-06542cef5de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:50.145924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9b78d-3ece-420d-97c6-06542cef5de0 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.146302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9b78d-3ece-420d-97c6-06542cef5de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.146886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9b78d-3ece-420d-97c6-06542cef5de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.152666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9b78d-3ece-420d-97c6-06542cef5de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:50.155023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9b78d-3ece-420d-97c6-06542cef5de0 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:50.242030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 863/1714] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:49 2022] POST /identity/v3/projects => generated 385 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:50.243921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b957376-2f51-4d77-be42-cea993b25469 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.250900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b957376-2f51-4d77-be42-cea993b25469 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.252786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b957376-2f51-4d77-be42-cea993b25469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.291077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0c526e-4964-4655-81d3-076a3fc17bcc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:50.301305 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:50.358193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-8b957376-2f51-4d77-be42-cea993b25469 None None] MFA Rules not processed for user `b9277840830b454c9097109a45d48927`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:50.359811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8b957376-2f51-4d77-be42-cea993b25469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:50.439852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4fd2-6f04-4e17-b81d-46d8ffdcd917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:50.440414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:50.441182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4fd2-6f04-4e17-b81d-46d8ffdcd917 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.441632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4fd2-6f04-4e17-b81d-46d8ffdcd917 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.442041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273b4fd2-6f04-4e17-b81d-46d8ffdcd917 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.442907 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b4fd2-6f04-4e17-b81d-46d8ffdcd917 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:50.446686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273b4fd2-6f04-4e17-b81d-46d8ffdcd917 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:50.516509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 852/1715] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:50 2022] POST /identity/v3/users => generated 292 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:50.517712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4fd2-6f04-4e17-b81d-46d8ffdcd917 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:50.527949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 864/1716] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:50.532246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b957376-2f51-4d77-be42-cea993b25469 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:50.557626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273b4fd2-6f04-4e17-b81d-46d8ffdcd917 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:50.570585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02a0b0d-249a-4c5b-97c6-da6326427979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:50.571421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a0b0d-249a-4c5b-97c6-da6326427979 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.571706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a0b0d-249a-4c5b-97c6-da6326427979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.571981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02a0b0d-249a-4c5b-97c6-da6326427979 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.572786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a0b0d-249a-4c5b-97c6-da6326427979 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:50.574976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b957376-2f51-4d77-be42-cea993b25469 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:50.578173 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02a0b0d-249a-4c5b-97c6-da6326427979 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:50.597124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7f1b5-d027-45a2-b1ae-3bef09c49d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:50.597871 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7f1b5-d027-45a2-b1ae-3bef09c49d9f admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.598252 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7f1b5-d027-45a2-b1ae-3bef09c49d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.598615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff7f1b5-d027-45a2-b1ae-3bef09c49d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.599470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7f1b5-d027-45a2-b1ae-3bef09c49d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:50.601430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff7f1b5-d027-45a2-b1ae-3bef09c49d9f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:50.637710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 853/1717] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:50 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:50.638081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb531a01-7a12-48ab-9784-16b57d3dd603 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.638523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb531a01-7a12-48ab-9784-16b57d3dd603 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.640352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb531a01-7a12-48ab-9784-16b57d3dd603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.642189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 865/1718] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:50.643150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7f1b5-d027-45a2-b1ae-3bef09c49d9f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:50.671988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff7f1b5-d027-45a2-b1ae-3bef09c49d9f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:50.680121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b002b-dbdb-4879-b066-f41ff854017d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:50.683093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b002b-dbdb-4879-b066-f41ff854017d admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.683475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b002b-dbdb-4879-b066-f41ff854017d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.683875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230b002b-dbdb-4879-b066-f41ff854017d admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.684681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b002b-dbdb-4879-b066-f41ff854017d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:50.686826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bb531a01-7a12-48ab-9784-16b57d3dd603 None None] MFA Rules not processed for user `b9277840830b454c9097109a45d48927`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:50.688109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230b002b-dbdb-4879-b066-f41ff854017d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:50.689460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bb531a01-7a12-48ab-9784-16b57d3dd603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:50.709170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 854/1719] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:50.710113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb531a01-7a12-48ab-9784-16b57d3dd603 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:50.710856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 866/1720] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:50.712015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b002b-dbdb-4879-b066-f41ff854017d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:50.731529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230b002b-dbdb-4879-b066-f41ff854017d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:50.732883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb531a01-7a12-48ab-9784-16b57d3dd603 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:50.740646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7442e44-0aa5-4cca-92ca-bdebbf7489cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:50.741461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7442e44-0aa5-4cca-92ca-bdebbf7489cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.743238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7442e44-0aa5-4cca-92ca-bdebbf7489cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.743238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7442e44-0aa5-4cca-92ca-bdebbf7489cc admin admin] PATH_INFO: `/v3/projects/4c095327aba549b49e0f21be40ac3c91/users/a5f65a6fc4c04bacbf5561a76f2ae496/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.744219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81519702-dcf0-48ec-9e98-0776a8dc8429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:50.744931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519702-dcf0-48ec-9e98-0776a8dc8429 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.745944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519702-dcf0-48ec-9e98-0776a8dc8429 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.745944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81519702-dcf0-48ec-9e98-0776a8dc8429 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.747004 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81519702-dcf0-48ec-9e98-0776a8dc8429 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:50.750684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81519702-dcf0-48ec-9e98-0776a8dc8429 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:50.777951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 867/1721] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:50.780007 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81519702-dcf0-48ec-9e98-0776a8dc8429 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:50.787328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7442e44-0aa5-4cca-92ca-bdebbf7489cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c095327aba549b49e0f21be40ac3c91, user_id=a5f65a6fc4c04bacbf5561a76f2ae496, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:50.790162 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7442e44-0aa5-4cca-92ca-bdebbf7489cc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:50.801312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81519702-dcf0-48ec-9e98-0776a8dc8429 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:50.814027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 855/1722] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:50 2022] PUT /identity/v3/projects/4c095327aba549b49e0f21be40ac3c91/users/a5f65a6fc4c04bacbf5561a76f2ae496/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:50.816850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6934cdc8-7ecd-44dd-8842-4885c3d49469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:50.818447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7442e44-0aa5-4cca-92ca-bdebbf7489cc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:50.819429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934cdc8-7ecd-44dd-8842-4885c3d49469 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.820465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934cdc8-7ecd-44dd-8842-4885c3d49469 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.821359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6934cdc8-7ecd-44dd-8842-4885c3d49469 admin admin] PATH_INFO: `/v3/projects/e6c29dbfc9ee4720993c4e3159ed9add/users/b5dd8a18f03349079cb53adafb6e445d/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.860410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934cdc8-7ecd-44dd-8842-4885c3d49469 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6c29dbfc9ee4720993c4e3159ed9add, user_id=b5dd8a18f03349079cb53adafb6e445d, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:50.863398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6934cdc8-7ecd-44dd-8842-4885c3d49469 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:50.887444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 868/1723] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:50 2022] PUT /identity/v3/projects/e6c29dbfc9ee4720993c4e3159ed9add/users/b5dd8a18f03349079cb53adafb6e445d/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:50.898981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb0b26-fa7a-48db-a648-a20da01e06fb None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.898981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb0b26-fa7a-48db-a648-a20da01e06fb None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.898981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cb0b26-fa7a-48db-a648-a20da01e06fb None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.900475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 869/1724] 10.222.0.59 () {54 vars in 912 bytes} [Thu Aug 18 21:05:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:50.908994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a435a31-305f-4642-8e48-1889749af473 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:50.914347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a435a31-305f-4642-8e48-1889749af473 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:50.914791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a435a31-305f-4642-8e48-1889749af473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:50.941754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7442e44-0aa5-4cca-92ca-bdebbf7489cc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:50.969709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-9a435a31-305f-4642-8e48-1889749af473 None None] MFA Rules not processed for user `b5dd8a18f03349079cb53adafb6e445d`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:50.971142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-9a435a31-305f-4642-8e48-1889749af473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:51.055109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:51.066829 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 870/1725] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:51.072804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f269a-4864-4487-930e-eb83e8884d0a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.075141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4f575-8266-4fe7-b2c3-e259c2d1f08e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:51.075718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4f575-8266-4fe7-b2c3-e259c2d1f08e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.076205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4f575-8266-4fe7-b2c3-e259c2d1f08e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.077079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd4f575-8266-4fe7-b2c3-e259c2d1f08e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.077487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f269a-4864-4487-930e-eb83e8884d0a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.077902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4f575-8266-4fe7-b2c3-e259c2d1f08e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:51.078286 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f269a-4864-4487-930e-eb83e8884d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.080041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd4f575-8266-4fe7-b2c3-e259c2d1f08e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:51.105732 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 856/1726] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:50 2022] GET /identity/v3/roles => generated 1420 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:51.106786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4f575-8266-4fe7-b2c3-e259c2d1f08e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:51.132896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd4f575-8266-4fe7-b2c3-e259c2d1f08e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:51.144684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdcf24-34a6-49b6-95e9-1e13f430ca4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:51.145652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdcf24-34a6-49b6-95e9-1e13f430ca4f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.146028 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdcf24-34a6-49b6-95e9-1e13f430ca4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.146417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdcf24-34a6-49b6-95e9-1e13f430ca4f admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.147189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdcf24-34a6-49b6-95e9-1e13f430ca4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:51.163920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdcf24-34a6-49b6-95e9-1e13f430ca4f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:51.164184 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ee4f269a-4864-4487-930e-eb83e8884d0a None None] MFA Rules not processed for user `309ebac21dd944029b1de80ba54dd794`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:51.168805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ee4f269a-4864-4487-930e-eb83e8884d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:51.223112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 857/1727] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:51 2022] POST /identity/v3/projects => generated 387 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:51.224471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdcf24-34a6-49b6-95e9-1e13f430ca4f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:51.284443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:51.319895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 871/1728] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:51.321943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f269a-4864-4487-930e-eb83e8884d0a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:51.336857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdcf24-34a6-49b6-95e9-1e13f430ca4f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:51.345157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344333fb-7159-4276-a608-055a0acad14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:51.346115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344333fb-7159-4276-a608-055a0acad14b admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.346543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344333fb-7159-4276-a608-055a0acad14b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.347164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344333fb-7159-4276-a608-055a0acad14b admin admin] PATH_INFO: `/v3/projects/4c095327aba549b49e0f21be40ac3c91/users/a5f65a6fc4c04bacbf5561a76f2ae496/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.349746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344333fb-7159-4276-a608-055a0acad14b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c095327aba549b49e0f21be40ac3c91, user_id=a5f65a6fc4c04bacbf5561a76f2ae496, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:51.355075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344333fb-7159-4276-a608-055a0acad14b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:51.356428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f269a-4864-4487-930e-eb83e8884d0a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:51.378713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e998bb7-f9b6-4d4a-afa6-a03f56602c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:51.379919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 858/1729] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:51 2022] PUT /identity/v3/projects/4c095327aba549b49e0f21be40ac3c91/users/a5f65a6fc4c04bacbf5561a76f2ae496/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:51.380784 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e998bb7-f9b6-4d4a-afa6-a03f56602c2d admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.381071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e998bb7-f9b6-4d4a-afa6-a03f56602c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.381346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e998bb7-f9b6-4d4a-afa6-a03f56602c2d admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.381579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344333fb-7159-4276-a608-055a0acad14b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:51.382001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e998bb7-f9b6-4d4a-afa6-a03f56602c2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:51.384212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-344333fb-7159-4276-a608-055a0acad14b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:51.385101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e998bb7-f9b6-4d4a-afa6-a03f56602c2d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:51.439076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 872/1730] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:51 2022] POST /identity/v3/users => generated 300 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:51.440262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270ebf-2426-45f2-aa78-729437a38c84 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.442467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270ebf-2426-45f2-aa78-729437a38c84 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.442710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9270ebf-2426-45f2-aa78-729437a38c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.497270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d9270ebf-2426-45f2-aa78-729437a38c84 None None] MFA Rules not processed for user `a5f65a6fc4c04bacbf5561a76f2ae496`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:51.498802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d9270ebf-2426-45f2-aa78-729437a38c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:51.575749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344333fb-7159-4276-a608-055a0acad14b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:51.580644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb6d67-eed1-4d26-ad68-bc81cf27d5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:51.581427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb6d67-eed1-4d26-ad68-bc81cf27d5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.581854 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb6d67-eed1-4d26-ad68-bc81cf27d5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.582290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb6d67-eed1-4d26-ad68-bc81cf27d5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.591501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb6d67-eed1-4d26-ad68-bc81cf27d5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:51.593289 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fb6d67-eed1-4d26-ad68-bc81cf27d5f1 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:51.601588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 873/1731] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:51.602379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9270ebf-2426-45f2-aa78-729437a38c84 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:51.616540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 859/1732] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:51 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:51.617673 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb6d67-eed1-4d26-ad68-bc81cf27d5f1 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:51.619411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b2fb6d67-eed1-4d26-ad68-bc81cf27d5f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:51.732700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb6d67-eed1-4d26-ad68-bc81cf27d5f1 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:51.792610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53272446-a279-4e41-95ee-71b17bc2de22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:51.793510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272446-a279-4e41-95ee-71b17bc2de22 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.793737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272446-a279-4e41-95ee-71b17bc2de22 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.794002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53272446-a279-4e41-95ee-71b17bc2de22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.798446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9270ebf-2426-45f2-aa78-729437a38c84 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:51.816128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62c936-c425-4cd8-b92f-863982597cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:51.816784 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62c936-c425-4cd8-b92f-863982597cd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.817073 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62c936-c425-4cd8-b92f-863982597cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.817347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62c936-c425-4cd8-b92f-863982597cd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.818016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62c936-c425-4cd8-b92f-863982597cd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:51.819855 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62c936-c425-4cd8-b92f-863982597cd4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:51.834522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53272446-a279-4e41-95ee-71b17bc2de22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:51.841495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 874/1733] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:51 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:51.844446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62c936-c425-4cd8-b92f-863982597cd4 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:51.865322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53272446-a279-4e41-95ee-71b17bc2de22 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:51.886994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62c936-c425-4cd8-b92f-863982597cd4 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:51.910948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 860/1734] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:51.916134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfac1b-6de0-432e-b969-857cb38f47a0 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.916134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfac1b-6de0-432e-b969-857cb38f47a0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.916134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfac1b-6de0-432e-b969-857cb38f47a0 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.921428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 861/1735] 10.222.0.59 () {54 vars in 912 bytes} [Thu Aug 18 21:05:51 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:51.928301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c704948-63fa-4277-ac64-1ab16f700827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:51.928301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c704948-63fa-4277-ac64-1ab16f700827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.928611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c704948-63fa-4277-ac64-1ab16f700827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.928611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c704948-63fa-4277-ac64-1ab16f700827 admin admin] PATH_INFO: `/v3/projects/ac4197d503dd48898020c5925c92b4ff/users/91cc7197021449b1996b887f5c23a50d/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.939185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279352b8-6241-4255-b089-f1b064eacae9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:51.939465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279352b8-6241-4255-b089-f1b064eacae9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:51.939743 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279352b8-6241-4255-b089-f1b064eacae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:51.969552 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c704948-63fa-4277-ac64-1ab16f700827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4197d503dd48898020c5925c92b4ff, user_id=91cc7197021449b1996b887f5c23a50d, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:51.972476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c704948-63fa-4277-ac64-1ab16f700827 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:51.997973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-279352b8-6241-4255-b089-f1b064eacae9 None None] MFA Rules not processed for user `309ebac21dd944029b1de80ba54dd794`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:52.004388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-279352b8-6241-4255-b089-f1b064eacae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:52.005714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 875/1736] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:51 2022] PUT /identity/v3/projects/ac4197d503dd48898020c5925c92b4ff/users/91cc7197021449b1996b887f5c23a50d/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:52.009478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c704948-63fa-4277-ac64-1ab16f700827 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:52.021801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:52.125212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:52.153766 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 862/1737] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:05:51 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:52.155581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279352b8-6241-4255-b089-f1b064eacae9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:52.191584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c704948-63fa-4277-ac64-1ab16f700827 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:52.196624 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3e2f8-b95b-4d2d-a421-f303982798b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:52.197456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3e2f8-b95b-4d2d-a421-f303982798b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.197745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3e2f8-b95b-4d2d-a421-f303982798b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.198019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c3e2f8-b95b-4d2d-a421-f303982798b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.198682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3e2f8-b95b-4d2d-a421-f303982798b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:52.200413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c3e2f8-b95b-4d2d-a421-f303982798b4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:52.215894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 876/1738] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:52 2022] GET /identity/v3/roles => generated 1420 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:52.215894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3e2f8-b95b-4d2d-a421-f303982798b4 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:52.218002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a6c3e2f8-b95b-4d2d-a421-f303982798b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:52.234945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c3e2f8-b95b-4d2d-a421-f303982798b4 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:52.241339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33899e37-f0ba-4b5e-8967-27803b315ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:52.242537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33899e37-f0ba-4b5e-8967-27803b315ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.243111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33899e37-f0ba-4b5e-8967-27803b315ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.244156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33899e37-f0ba-4b5e-8967-27803b315ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.258314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33899e37-f0ba-4b5e-8967-27803b315ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:52.262591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33899e37-f0ba-4b5e-8967-27803b315ed3 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:52.266730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279352b8-6241-4255-b089-f1b064eacae9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:52.271908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a055d62-7b24-44a9-92b7-302a23cbfca0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:52.272687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a055d62-7b24-44a9-92b7-302a23cbfca0 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.273061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 877/1739] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:52.273170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a055d62-7b24-44a9-92b7-302a23cbfca0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.273502 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a055d62-7b24-44a9-92b7-302a23cbfca0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.273733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33899e37-f0ba-4b5e-8967-27803b315ed3 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:52.287594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33899e37-f0ba-4b5e-8967-27803b315ed3 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:52.293981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1ce315-bf38-4aa0-a20e-9cebb122506e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:52.294663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ce315-bf38-4aa0-a20e-9cebb122506e admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.295020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ce315-bf38-4aa0-a20e-9cebb122506e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.295498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1ce315-bf38-4aa0-a20e-9cebb122506e admin admin] PATH_INFO: `/v3/projects/ac4197d503dd48898020c5925c92b4ff/users/91cc7197021449b1996b887f5c23a50d/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.298378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ce315-bf38-4aa0-a20e-9cebb122506e admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac4197d503dd48898020c5925c92b4ff, user_id=91cc7197021449b1996b887f5c23a50d, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:52.301399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1ce315-bf38-4aa0-a20e-9cebb122506e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:52.317759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 878/1740] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:52 2022] PUT /identity/v3/projects/ac4197d503dd48898020c5925c92b4ff/users/91cc7197021449b1996b887f5c23a50d/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:52.329155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52664a56-fee5-4f04-a684-7a2cb2947ad7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.331601 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52664a56-fee5-4f04-a684-7a2cb2947ad7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.333893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52664a56-fee5-4f04-a684-7a2cb2947ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.398302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-52664a56-fee5-4f04-a684-7a2cb2947ad7 None None] MFA Rules not processed for user `91cc7197021449b1996b887f5c23a50d`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:52.399715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-52664a56-fee5-4f04-a684-7a2cb2947ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:52.425270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a055d62-7b24-44a9-92b7-302a23cbfca0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:52.432527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a055d62-7b24-44a9-92b7-302a23cbfca0 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:52.447680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 863/1741] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:52.478821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d894e-19a3-4f3a-b996-4f3661a6450c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.479232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d894e-19a3-4f3a-b996-4f3661a6450c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.479517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d894e-19a3-4f3a-b996-4f3661a6450c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.524512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 879/1742] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:52.550643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52664a56-fee5-4f04-a684-7a2cb2947ad7 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:52.552474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-52664a56-fee5-4f04-a684-7a2cb2947ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:52.553617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-307d894e-19a3-4f3a-b996-4f3661a6450c None None] MFA Rules not processed for user `dda19c20bfec49b8b9e1d589f7e3e188`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:52.564863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-307d894e-19a3-4f3a-b996-4f3661a6450c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:52.719549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 864/1743] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:52.720455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52664a56-fee5-4f04-a684-7a2cb2947ad7 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:52.722360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f36a8-50e7-4a63-b7ae-7a30e222ccea None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.722857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f36a8-50e7-4a63-b7ae-7a30e222ccea None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.723254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9f36a8-50e7-4a63-b7ae-7a30e222ccea None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.725288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 865/1744] 10.222.0.59 () {54 vars in 961 bytes} [Thu Aug 18 21:05:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:05:52.730674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d2a79-874d-462a-b4f1-4496d099eb41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:52.731624 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2a79-874d-462a-b4f1-4496d099eb41 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.731713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2a79-874d-462a-b4f1-4496d099eb41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.731915 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d2a79-874d-462a-b4f1-4496d099eb41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.751759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaf4f4-a155-4067-9929-f0b8f2be8949 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:52.752462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaf4f4-a155-4067-9929-f0b8f2be8949 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:52.753247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aaf4f4-a155-4067-9929-f0b8f2be8949 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:52.759975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d2a79-874d-462a-b4f1-4496d099eb41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:52.762297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522d2a79-874d-462a-b4f1-4496d099eb41 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:52.793277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 880/1745] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:52.846760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-05aaf4f4-a155-4067-9929-f0b8f2be8949 None None] MFA Rules not processed for user `16a4ba52fe124009a570fd1408903cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:52.853155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-05aaf4f4-a155-4067-9929-f0b8f2be8949 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:52.877533 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d2a79-874d-462a-b4f1-4496d099eb41 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:52.911282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:52.988256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:53.038598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d2a79-874d-462a-b4f1-4496d099eb41 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:53.051241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:53.052184 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:53.052466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:53.052712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] PATH_INFO: `/v3/users/b5dd8a18f03349079cb53adafb6e445d` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:53.055140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5dd8a18f03349079cb53adafb6e445d)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:53.057393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:53.076635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 866/1746] 10.222.0.59 () {58 vars in 1058 bytes} [Thu Aug 18 21:05:52 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:53.085097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaf4f4-a155-4067-9929-f0b8f2be8949 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:53.171496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5dd8a18f03349079cb53adafb6e445d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:53.196833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5dd8a18f03349079cb53adafb6e445d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:53.197381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aaf4f4-a155-4067-9929-f0b8f2be8949 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:53.206272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86494f05-16f6-4f13-9082-da2b73c69bf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:53.207358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86494f05-16f6-4f13-9082-da2b73c69bf7 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:53.207795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86494f05-16f6-4f13-9082-da2b73c69bf7 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:53.208176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86494f05-16f6-4f13-9082-da2b73c69bf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:53.214484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5dd8a18f03349079cb53adafb6e445d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:53.227238 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5dd8a18f03349079cb53adafb6e445d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:53.228662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5dd8a18f03349079cb53adafb6e445d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:53.250029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 881/1747] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:52 2022] DELETE /identity/v3/users/b5dd8a18f03349079cb53adafb6e445d => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:53.251933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:53.255415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:53.354258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86494f05-16f6-4f13-9082-da2b73c69bf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:53.354258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86494f05-16f6-4f13-9082-da2b73c69bf7 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:53.367977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 867/1748] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:53 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:53.369184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafe225-587d-4817-9096-cc0494eca259 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:53.369588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafe225-587d-4817-9096-cc0494eca259 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:53.369864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafe225-587d-4817-9096-cc0494eca259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:53.396411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3fafe225-587d-4817-9096-cc0494eca259 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:53.396411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3fafe225-587d-4817-9096-cc0494eca259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:53.455654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:53.499617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c714f64f-fb29-404d-b63c-0c57647bfc25 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:53.504661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 868/1749] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:53.505680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafe225-587d-4817-9096-cc0494eca259 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:53.508297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3fafe225-587d-4817-9096-cc0494eca259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:53.528016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ef85b-7dc5-4c36-81ee-ce017f4099e0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:53.528536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ef85b-7dc5-4c36-81ee-ce017f4099e0 service placement] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:53.528818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ef85b-7dc5-4c36-81ee-ce017f4099e0 service placement] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:53.529131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3ef85b-7dc5-4c36-81ee-ce017f4099e0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:53.536468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7c3ef85b-7dc5-4c36-81ee-ce017f4099e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:53.552591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafe225-587d-4817-9096-cc0494eca259 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:53.563708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34892e3-8517-4d91-a036-9c0ba0579b37 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:53.566734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34892e3-8517-4d91-a036-9c0ba0579b37 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:53.567113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34892e3-8517-4d91-a036-9c0ba0579b37 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:53.567490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34892e3-8517-4d91-a036-9c0ba0579b37 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:53.568431 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ef85b-7dc5-4c36-81ee-ce017f4099e0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:53.570967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3ef85b-7dc5-4c36-81ee-ce017f4099e0 service placement] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:53.581253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34892e3-8517-4d91-a036-9c0ba0579b37 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:53.584328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34892e3-8517-4d91-a036-9c0ba0579b37 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:53.599569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 869/1750] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:53.600722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34892e3-8517-4d91-a036-9c0ba0579b37 service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:53.607180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a34892e3-8517-4d91-a036-9c0ba0579b37 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:53.610595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 882/1751] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:53 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:53.842430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34892e3-8517-4d91-a036-9c0ba0579b37 service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:53.856011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d155f6-55a4-4f51-a747-03e9600faa3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:53.856662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d155f6-55a4-4f51-a747-03e9600faa3e service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:53.856944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d155f6-55a4-4f51-a747-03e9600faa3e service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:53.857259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d155f6-55a4-4f51-a747-03e9600faa3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:53.885042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d155f6-55a4-4f51-a747-03e9600faa3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:53.888575 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d155f6-55a4-4f51-a747-03e9600faa3e service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:53.916544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 870/1752] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:05:54.879416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ef85b-7dc5-4c36-81ee-ce017f4099e0 service placement] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:54.881033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7c3ef85b-7dc5-4c36-81ee-ce017f4099e0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:54.908867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3ef85b-7dc5-4c36-81ee-ce017f4099e0 service placement] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:54.915432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:54.916597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:54.917824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:54.918327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] PATH_INFO: `/v3/projects/e6c29dbfc9ee4720993c4e3159ed9add` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:54.920502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6c29dbfc9ee4720993c4e3159ed9add)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:54.923570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:55.049149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:55.062116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6c29dbfc9ee4720993c4e3159ed9add', 'request_id': 'req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:55.083663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6c29dbfc9ee4720993c4e3159ed9add', 'request_id': 'req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:55.111142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6c29dbfc9ee4720993c4e3159ed9add', 'request_id': 'req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:55.145020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] The token cache is being invalidate because project e6c29dbfc9ee4720993c4e3159ed9add was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:55.145312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:55.145999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4e25f625-d7b1-4b9d-b803-ca4f8f1ecca1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:55.147593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 883/1753] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:54 2022] DELETE /identity/v3/projects/e6c29dbfc9ee4720993c4e3159ed9add => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:55.151866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d155f6-55a4-4f51-a747-03e9600faa3e service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:55.175206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d155f6-55a4-4f51-a747-03e9600faa3e service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:55.406201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f2a42-06c3-4d8d-a5de-feb0d4548e3c None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:55.406677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f2a42-06c3-4d8d-a5de-feb0d4548e3c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:55.407084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f2a42-06c3-4d8d-a5de-feb0d4548e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:55.448969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-016f2a42-06c3-4d8d-a5de-feb0d4548e3c None None] MFA Rules not processed for user `b9277840830b454c9097109a45d48927`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:55.449378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:55.450724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-016f2a42-06c3-4d8d-a5de-feb0d4548e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:55.452455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:55.453074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:55.453361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] PATH_INFO: `/v3/users/91cc7197021449b1996b887f5c23a50d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:55.458485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=91cc7197021449b1996b887f5c23a50d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:55.463853 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:55.589785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 884/1754] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:55.619383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91cc7197021449b1996b887f5c23a50d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:55.621937 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91cc7197021449b1996b887f5c23a50d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:55.624613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91cc7197021449b1996b887f5c23a50d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:55.656799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91cc7197021449b1996b887f5c23a50d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:55.676946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3e7ad479-6bb1-4099-ac95-b30620fb5b78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91cc7197021449b1996b887f5c23a50d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:55.710437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:55.744287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 871/1755] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:05:55 2022] DELETE /identity/v3/users/91cc7197021449b1996b887f5c23a50d => generated 0 bytes in 593 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:05:56.828006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f2a42-06c3-4d8d-a5de-feb0d4548e3c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:56.829651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-016f2a42-06c3-4d8d-a5de-feb0d4548e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:56.898142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f2a42-06c3-4d8d-a5de-feb0d4548e3c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:57.155991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:57.156680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:57.156961 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:57.157235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] PATH_INFO: `/v3/projects/ac4197d503dd48898020c5925c92b4ff` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:57.165789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac4197d503dd48898020c5925c92b4ff)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:57.167916 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:57.318537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac4197d503dd48898020c5925c92b4ff', 'request_id': 'req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:57.327212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac4197d503dd48898020c5925c92b4ff', 'request_id': 'req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:57.343464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac4197d503dd48898020c5925c92b4ff', 'request_id': 'req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:57.372970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] The token cache is being invalidate because project ac4197d503dd48898020c5925c92b4ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:05:57.373266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:57.375395 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2d4aea3c-6095-452b-ae9d-8ae143bbdd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:05:57.380626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 885/1756] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:05:56 2022] DELETE /identity/v3/projects/ac4197d503dd48898020c5925c92b4ff => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:05:57.382413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f48bb-2c3d-493a-ae6b-4c95ab52fc3a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:57.382912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f48bb-2c3d-493a-ae6b-4c95ab52fc3a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:57.383014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1f48bb-2c3d-493a-ae6b-4c95ab52fc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:57.412320 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6a1f48bb-2c3d-493a-ae6b-4c95ab52fc3a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:57.414132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6a1f48bb-2c3d-493a-ae6b-4c95ab52fc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:57.508176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 872/1757] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:57.516399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aba712-9cc6-4690-85ef-3804041fd42b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:57.516691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aba712-9cc6-4690-85ef-3804041fd42b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:57.517013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1aba712-9cc6-4690-85ef-3804041fd42b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:57.537324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:57.557050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-f1aba712-9cc6-4690-85ef-3804041fd42b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:57.559544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f1aba712-9cc6-4690-85ef-3804041fd42b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:57.570672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 886/1758] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:57.575100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f48bb-2c3d-493a-ae6b-4c95ab52fc3a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:57.590360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1f48bb-2c3d-493a-ae6b-4c95ab52fc3a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:57.602321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fb966-2fca-4727-98db-6e1ff22177b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:57.603073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb966-2fca-4727-98db-6e1ff22177b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:57.603357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb966-2fca-4727-98db-6e1ff22177b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:57.603624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb966-2fca-4727-98db-6e1ff22177b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:57.604593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fb966-2fca-4727-98db-6e1ff22177b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:05:57.605402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fb966-2fca-4727-98db-6e1ff22177b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:57.606642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fb966-2fca-4727-98db-6e1ff22177b5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:57.632730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 873/1759] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:05:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:05:57.637794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aba712-9cc6-4690-85ef-3804041fd42b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:57.651169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1aba712-9cc6-4690-85ef-3804041fd42b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:57.657481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ce8bd-b0e8-4f3b-9ee4-297436c0784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:57.658122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce8bd-b0e8-4f3b-9ee4-297436c0784c admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:57.658599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce8bd-b0e8-4f3b-9ee4-297436c0784c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:57.658919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60ce8bd-b0e8-4f3b-9ee4-297436c0784c admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:57.659709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ce8bd-b0e8-4f3b-9ee4-297436c0784c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:57.662285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60ce8bd-b0e8-4f3b-9ee4-297436c0784c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:57.745418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 887/1760] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:57 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:57.746175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fb966-2fca-4727-98db-6e1ff22177b5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:57.782165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fb966-2fca-4727-98db-6e1ff22177b5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:57.890460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d3cc-4b42-4e59-acf3-48fe609574b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:57.891420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d3cc-4b42-4e59-acf3-48fe609574b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:57.891773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d3cc-4b42-4e59-acf3-48fe609574b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:57.892121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f8d3cc-4b42-4e59-acf3-48fe609574b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:57.892849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8d3cc-4b42-4e59-acf3-48fe609574b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:57.896549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f8d3cc-4b42-4e59-acf3-48fe609574b9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:57.936660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ce8bd-b0e8-4f3b-9ee4-297436c0784c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:57.938364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 874/1761] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:57 2022] POST /identity/v3/users => generated 293 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:05:57.951412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60ce8bd-b0e8-4f3b-9ee4-297436c0784c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:57.966715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed72840-38e8-4d1d-9fa5-4448eb090507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:57.967472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72840-38e8-4d1d-9fa5-4448eb090507 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:57.968091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72840-38e8-4d1d-9fa5-4448eb090507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:57.968365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed72840-38e8-4d1d-9fa5-4448eb090507 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:57.969063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed72840-38e8-4d1d-9fa5-4448eb090507 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:57.970627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed72840-38e8-4d1d-9fa5-4448eb090507 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:57.997691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 888/1762] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:57 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:58.002995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d3cc-4b42-4e59-acf3-48fe609574b9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:58.015385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f8d3cc-4b42-4e59-acf3-48fe609574b9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:58.021362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab52903f-7cd1-4dab-b290-4d1490b28f28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:58.022865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52903f-7cd1-4dab-b290-4d1490b28f28 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.023339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52903f-7cd1-4dab-b290-4d1490b28f28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.023799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab52903f-7cd1-4dab-b290-4d1490b28f28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.024664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52903f-7cd1-4dab-b290-4d1490b28f28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:58.026542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab52903f-7cd1-4dab-b290-4d1490b28f28 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:58.040456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 875/1763] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:05:58.044733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed72840-38e8-4d1d-9fa5-4448eb090507 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:58.056689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed72840-38e8-4d1d-9fa5-4448eb090507 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:58.063424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa0569-9585-49ad-889a-7068663ba9f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:58.064412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0569-9585-49ad-889a-7068663ba9f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.064851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0569-9585-49ad-889a-7068663ba9f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.065268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aa0569-9585-49ad-889a-7068663ba9f0 admin admin] PATH_INFO: `/v3/projects/380d8b0930694234af750923a248547a/users/a3b2c6226c174b1d9283adc33299c40c/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.084931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa0569-9585-49ad-889a-7068663ba9f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=380d8b0930694234af750923a248547a, user_id=a3b2c6226c174b1d9283adc33299c40c, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:58.087830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7aa0569-9585-49ad-889a-7068663ba9f0 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:58.106813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 889/1764] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:58 2022] PUT /identity/v3/projects/380d8b0930694234af750923a248547a/users/a3b2c6226c174b1d9283adc33299c40c/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:58.115869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6be64e-fefd-40fb-8574-d2a5235495a0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.116156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6be64e-fefd-40fb-8574-d2a5235495a0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.116423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6be64e-fefd-40fb-8574-d2a5235495a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.149869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fc6be64e-fefd-40fb-8574-d2a5235495a0 None None] MFA Rules not processed for user `a3b2c6226c174b1d9283adc33299c40c`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:58.151210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fc6be64e-fefd-40fb-8574-d2a5235495a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:58.258210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:58.274225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 876/1765] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:58.278677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa0569-9585-49ad-889a-7068663ba9f0 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:58.359634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aa0569-9585-49ad-889a-7068663ba9f0 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:58.364463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8116-eb2e-484d-87ea-a0b975e06757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:58.365181 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8116-eb2e-484d-87ea-a0b975e06757 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.365535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8116-eb2e-484d-87ea-a0b975e06757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.365877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622e8116-eb2e-484d-87ea-a0b975e06757 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.366592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8116-eb2e-484d-87ea-a0b975e06757 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:58.368642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622e8116-eb2e-484d-87ea-a0b975e06757 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:58.404071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 890/1766] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:58 2022] POST /identity/v3/projects => generated 387 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:58.405988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6be64e-fefd-40fb-8574-d2a5235495a0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:58.417920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6be64e-fefd-40fb-8574-d2a5235495a0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:58.483622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b9c77-676e-4f00-844c-ce0dac54076d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:58.484244 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b9c77-676e-4f00-844c-ce0dac54076d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.484529 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b9c77-676e-4f00-844c-ce0dac54076d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.484802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37b9c77-676e-4f00-844c-ce0dac54076d admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.485439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b9c77-676e-4f00-844c-ce0dac54076d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:58.487466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37b9c77-676e-4f00-844c-ce0dac54076d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:58.512877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 877/1767] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:58 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:58.517685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8116-eb2e-484d-87ea-a0b975e06757 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:58.531088 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622e8116-eb2e-484d-87ea-a0b975e06757 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:58.535792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29538b51-68df-42ef-9ee3-f789b9f92e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:58.536407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538b51-68df-42ef-9ee3-f789b9f92e6d admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.537084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538b51-68df-42ef-9ee3-f789b9f92e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.537367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29538b51-68df-42ef-9ee3-f789b9f92e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.538018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29538b51-68df-42ef-9ee3-f789b9f92e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:58.539698 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29538b51-68df-42ef-9ee3-f789b9f92e6d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:58.551686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 891/1768] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:58.556023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b9c77-676e-4f00-844c-ce0dac54076d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:58.566668 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37b9c77-676e-4f00-844c-ce0dac54076d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:58.571306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64700f80-12f1-497d-83db-9bdf46ecc23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:58.571877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64700f80-12f1-497d-83db-9bdf46ecc23c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.572186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64700f80-12f1-497d-83db-9bdf46ecc23c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.572440 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64700f80-12f1-497d-83db-9bdf46ecc23c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.573095 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64700f80-12f1-497d-83db-9bdf46ecc23c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:58.574706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64700f80-12f1-497d-83db-9bdf46ecc23c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:58.585550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 878/1769] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:58.590063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29538b51-68df-42ef-9ee3-f789b9f92e6d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:58.604230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29538b51-68df-42ef-9ee3-f789b9f92e6d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:58.612868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4897a7c-1186-4fba-98f8-8969309167f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:58.613937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897a7c-1186-4fba-98f8-8969309167f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.614938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897a7c-1186-4fba-98f8-8969309167f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.615255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4897a7c-1186-4fba-98f8-8969309167f1 admin admin] PATH_INFO: `/v3/projects/a62d7c356c9745f8abf0e61dfeb949ab/users/e186365d4a354bf1a2cf9c0ae2990273/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.636095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4897a7c-1186-4fba-98f8-8969309167f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a62d7c356c9745f8abf0e61dfeb949ab, user_id=e186365d4a354bf1a2cf9c0ae2990273, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:58.638981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4897a7c-1186-4fba-98f8-8969309167f1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:58.655417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 892/1770] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:58 2022] PUT /identity/v3/projects/a62d7c356c9745f8abf0e61dfeb949ab/users/e186365d4a354bf1a2cf9c0ae2990273/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:58.665770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b75de-c697-47aa-8719-feef33f27021 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.666049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b75de-c697-47aa-8719-feef33f27021 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.666317 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369b75de-c697-47aa-8719-feef33f27021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.698458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-369b75de-c697-47aa-8719-feef33f27021 None None] MFA Rules not processed for user `e186365d4a354bf1a2cf9c0ae2990273`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:58.699897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-369b75de-c697-47aa-8719-feef33f27021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:58.794422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 879/1771] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:58 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:58.799788 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4897a7c-1186-4fba-98f8-8969309167f1 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:58.879176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:58.893023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4897a7c-1186-4fba-98f8-8969309167f1 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:58.898296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316bea9-a2d1-43cd-aba7-9d5b1659a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:58.898951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316bea9-a2d1-43cd-aba7-9d5b1659a833 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:58.899234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316bea9-a2d1-43cd-aba7-9d5b1659a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:58.899787 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316bea9-a2d1-43cd-aba7-9d5b1659a833 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:58.900424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316bea9-a2d1-43cd-aba7-9d5b1659a833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:58.902345 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316bea9-a2d1-43cd-aba7-9d5b1659a833 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:58.934968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 893/1772] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:05:58 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:05:58.937792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b75de-c697-47aa-8719-feef33f27021 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:58.970842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369b75de-c697-47aa-8719-feef33f27021 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:59.058035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3588ce-eaab-4863-b41a-5b810a147a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:59.058659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3588ce-eaab-4863-b41a-5b810a147a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:59.058972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3588ce-eaab-4863-b41a-5b810a147a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:59.059290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3588ce-eaab-4863-b41a-5b810a147a9d admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:59.059889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3588ce-eaab-4863-b41a-5b810a147a9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:59.063030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3588ce-eaab-4863-b41a-5b810a147a9d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:59.073772 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:05:59.094259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 880/1773] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:05:58 2022] POST /identity/v3/users => generated 300 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:05:59.102470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316bea9-a2d1-43cd-aba7-9d5b1659a833 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:59.113538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316bea9-a2d1-43cd-aba7-9d5b1659a833 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:59.118309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4016d6a-ac26-4d46-b16c-bc2f57613af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:59.119020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4016d6a-ac26-4d46-b16c-bc2f57613af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:59.119743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4016d6a-ac26-4d46-b16c-bc2f57613af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:59.119743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4016d6a-ac26-4d46-b16c-bc2f57613af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:59.120208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4016d6a-ac26-4d46-b16c-bc2f57613af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:59.121943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4016d6a-ac26-4d46-b16c-bc2f57613af0 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:59.134909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 894/1774] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:05:59.139710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3588ce-eaab-4863-b41a-5b810a147a9d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:59.151211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3588ce-eaab-4863-b41a-5b810a147a9d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:59.156958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89d74c-28e6-4fde-bfbf-032dc03b26be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:59.157660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89d74c-28e6-4fde-bfbf-032dc03b26be admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:59.157968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89d74c-28e6-4fde-bfbf-032dc03b26be admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:59.158248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89d74c-28e6-4fde-bfbf-032dc03b26be admin admin] PATH_INFO: `/v3/projects/403517970fbb40a9803969eb6b495806/users/ba7bb5074272483688230bcebec6d64f/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:59.173757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89d74c-28e6-4fde-bfbf-032dc03b26be admin admin] RBAC: Authorizing `identity:create_grant(project_id=403517970fbb40a9803969eb6b495806, user_id=ba7bb5074272483688230bcebec6d64f, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:59.176493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89d74c-28e6-4fde-bfbf-032dc03b26be admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:59.192371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 881/1775] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:59 2022] PUT /identity/v3/projects/403517970fbb40a9803969eb6b495806/users/ba7bb5074272483688230bcebec6d64f/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:59.197312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4016d6a-ac26-4d46-b16c-bc2f57613af0 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:59.207961 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4016d6a-ac26-4d46-b16c-bc2f57613af0 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:59.265323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95182ace-f7ff-4c00-a99f-97268255f4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:59.265943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95182ace-f7ff-4c00-a99f-97268255f4df admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:59.266220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95182ace-f7ff-4c00-a99f-97268255f4df admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:59.266480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95182ace-f7ff-4c00-a99f-97268255f4df admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:59.267162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95182ace-f7ff-4c00-a99f-97268255f4df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:59.269126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95182ace-f7ff-4c00-a99f-97268255f4df admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:59.279582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 895/1776] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:05:59 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:05:59.284356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89d74c-28e6-4fde-bfbf-032dc03b26be admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:59.296232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89d74c-28e6-4fde-bfbf-032dc03b26be admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:59.301857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326cf48-0725-4e83-883d-96f6d5fc2a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:59.302524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326cf48-0725-4e83-883d-96f6d5fc2a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:59.302795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326cf48-0725-4e83-883d-96f6d5fc2a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:59.303097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4326cf48-0725-4e83-883d-96f6d5fc2a5f admin admin] PATH_INFO: `/v3/projects/403517970fbb40a9803969eb6b495806/users/ba7bb5074272483688230bcebec6d64f/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:59.305106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326cf48-0725-4e83-883d-96f6d5fc2a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=403517970fbb40a9803969eb6b495806, user_id=ba7bb5074272483688230bcebec6d64f, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:59.307782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4326cf48-0725-4e83-883d-96f6d5fc2a5f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:59.318720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 882/1777] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:05:59 2022] PUT /identity/v3/projects/403517970fbb40a9803969eb6b495806/users/ba7bb5074272483688230bcebec6d64f/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:05:59.330508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6584-a86e-4d18-95e0-fbfd31828dde None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:59.330857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6584-a86e-4d18-95e0-fbfd31828dde None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:59.331123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c6584-a86e-4d18-95e0-fbfd31828dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:59.359609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-073c6584-a86e-4d18-95e0-fbfd31828dde None None] MFA Rules not processed for user `ba7bb5074272483688230bcebec6d64f`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:05:59.360843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-073c6584-a86e-4d18-95e0-fbfd31828dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:59.431999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 896/1778] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:05:59 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:05:59.443244 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326cf48-0725-4e83-883d-96f6d5fc2a5f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:05:59.445027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4326cf48-0725-4e83-883d-96f6d5fc2a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:05:59.506681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4326cf48-0725-4e83-883d-96f6d5fc2a5f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:05:59.511240 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c3582-2107-4200-b6cd-763a2f9ab3c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:05:59.511846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c3582-2107-4200-b6cd-763a2f9ab3c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:05:59.512132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c3582-2107-4200-b6cd-763a2f9ab3c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:05:59.512399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c3582-2107-4200-b6cd-763a2f9ab3c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:05:59.522817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c3582-2107-4200-b6cd-763a2f9ab3c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:05:59.524284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c3582-2107-4200-b6cd-763a2f9ab3c2 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:05:59.534516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 883/1779] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:05:59 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:00.227832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef7ca-fed7-484f-91b0-67689141e68f None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:00.228847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef7ca-fed7-484f-91b0-67689141e68f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:00.229284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ef7ca-fed7-484f-91b0-67689141e68f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:00.306058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c3582-2107-4200-b6cd-763a2f9ab3c2 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:00.308123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-862c3582-2107-4200-b6cd-763a2f9ab3c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:00.327560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c3582-2107-4200-b6cd-763a2f9ab3c2 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:00.332351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-242ef7ca-fed7-484f-91b0-67689141e68f None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:00.333643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-242ef7ca-fed7-484f-91b0-67689141e68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:00.336591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2ec4d-b081-4b71-b1d5-4353493b77aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:00.337463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2ec4d-b081-4b71-b1d5-4353493b77aa service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:00.337920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2ec4d-b081-4b71-b1d5-4353493b77aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:00.338344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce2ec4d-b081-4b71-b1d5-4353493b77aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:00.401972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:00.518723 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2ec4d-b081-4b71-b1d5-4353493b77aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:00.527081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce2ec4d-b081-4b71-b1d5-4353493b77aa service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:00.554790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 897/1780] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:06:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 328 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:00.561132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 884/1781] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:00.880910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef7ca-fed7-484f-91b0-67689141e68f None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:00.882548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-242ef7ca-fed7-484f-91b0-67689141e68f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:01.107146 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ef7ca-fed7-484f-91b0-67689141e68f None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:01.121744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2138d9e-43c9-471b-8e88-2a44c873ad29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:01.122576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2138d9e-43c9-471b-8e88-2a44c873ad29 service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:01.122964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2138d9e-43c9-471b-8e88-2a44c873ad29 service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:01.123379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2138d9e-43c9-471b-8e88-2a44c873ad29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:01.135768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2138d9e-43c9-471b-8e88-2a44c873ad29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:01.137716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2138d9e-43c9-471b-8e88-2a44c873ad29 service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:01.148338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 898/1782] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:06:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:06:02.261066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2ec4d-b081-4b71-b1d5-4353493b77aa service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:02.266010 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8ce2ec4d-b081-4b71-b1d5-4353493b77aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:02.588729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:02.601946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce2ec4d-b081-4b71-b1d5-4353493b77aa service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:02.621042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:02.621042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:02.621042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:02.621042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] PATH_INFO: `/v3/users/300eb6f1cdcd48bf9f66045cfb67acc8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:02.621345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=300eb6f1cdcd48bf9f66045cfb67acc8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:02.621345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:02.826269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '300eb6f1cdcd48bf9f66045cfb67acc8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:02.827421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '300eb6f1cdcd48bf9f66045cfb67acc8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:02.830579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '300eb6f1cdcd48bf9f66045cfb67acc8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:02.932875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '300eb6f1cdcd48bf9f66045cfb67acc8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:02.948327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '300eb6f1cdcd48bf9f66045cfb67acc8'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:03.017841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 885/1783] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:02 2022] DELETE /identity/v3/users/300eb6f1cdcd48bf9f66045cfb67acc8 => generated 0 bytes in 762 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:03.030799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e5b5-7336-43a8-860f-22214c0c62ee None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:03.030799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e5b5-7336-43a8-860f-22214c0c62ee None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:03.030799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133e5b5-7336-43a8-860f-22214c0c62ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:03.070075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-c133e5b5-7336-43a8-860f-22214c0c62ee None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:03.071359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c133e5b5-7336-43a8-860f-22214c0c62ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:03.215527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 899/1784] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:03.258130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:03.259834 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:03.396935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9364-af6b-4e78-8b1e-347005e99b0b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:03.397220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9364-af6b-4e78-8b1e-347005e99b0b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:03.397517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ee9364-af6b-4e78-8b1e-347005e99b0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:03.495318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-c5ee9364-af6b-4e78-8b1e-347005e99b0b None None] MFA Rules not processed for user `309ebac21dd944029b1de80ba54dd794`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:03.500389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c5ee9364-af6b-4e78-8b1e-347005e99b0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:03.522301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdf4609-c5da-46d0-a5ed-a89e801dc5d5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:03.540002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 900/1785] 10.222.0.73 () {58 vars in 1015 bytes} [Thu Aug 18 21:06:03 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:03.541077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cc6ec-9ae5-426f-83cb-e6d72b550871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:03.544698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cc6ec-9ae5-426f-83cb-e6d72b550871 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:03.545405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cc6ec-9ae5-426f-83cb-e6d72b550871 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:03.545922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07cc6ec-9ae5-426f-83cb-e6d72b550871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:03.580513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cc6ec-9ae5-426f-83cb-e6d72b550871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:03.583092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07cc6ec-9ae5-426f-83cb-e6d72b550871 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:03.592375 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee9364-af6b-4e78-8b1e-347005e99b0b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:03.606243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ee9364-af6b-4e78-8b1e-347005e99b0b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:03.617070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9c0fd-8d96-4091-b9bf-c2d21e344607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:03.620495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c0fd-8d96-4091-b9bf-c2d21e344607 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:03.621606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c0fd-8d96-4091-b9bf-c2d21e344607 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:03.622067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9c0fd-8d96-4091-b9bf-c2d21e344607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:03.640934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 886/1786] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:03.663448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9c0fd-8d96-4091-b9bf-c2d21e344607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:03.666021 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9c0fd-8d96-4091-b9bf-c2d21e344607 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:03.691520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 901/1787] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:03 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:04.537371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cc6ec-9ae5-426f-83cb-e6d72b550871 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:04.540354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d07cc6ec-9ae5-426f-83cb-e6d72b550871 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:04.580666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07cc6ec-9ae5-426f-83cb-e6d72b550871 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:04.609272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:04.611571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:04.612675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:04.615412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] PATH_INFO: `/v3/users/7298befd82974e99ad424528c3a03106` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:04.619048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7298befd82974e99ad424528c3a03106)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:04.622630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:04.762755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7298befd82974e99ad424528c3a03106'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:04.763699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7298befd82974e99ad424528c3a03106'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:04.764695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7298befd82974e99ad424528c3a03106'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:04.799307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7298befd82974e99ad424528c3a03106'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:04.822133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7298befd82974e99ad424528c3a03106'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:04.826551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:04.866501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 887/1788] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:04 2022] DELETE /identity/v3/users/7298befd82974e99ad424528c3a03106 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:04.871970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeb861-3996-488c-937a-b722b61a1185 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:04.873614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeb861-3996-488c-937a-b722b61a1185 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:04.873614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54eeb861-3996-488c-937a-b722b61a1185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:04.918985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-54eeb861-3996-488c-937a-b722b61a1185 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:04.924037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-54eeb861-3996-488c-937a-b722b61a1185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:04.935411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:05.084415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 902/1789] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:05.468695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:05.474330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:05.714249 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf3a5bd-2f0e-4ad1-9209-ed8ba6e0ee91 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:05.726183 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4f6e7-32c9-440d-bc70-2123781ff629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:05.726856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4f6e7-32c9-440d-bc70-2123781ff629 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:05.730415 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4f6e7-32c9-440d-bc70-2123781ff629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:05.731014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4f6e7-32c9-440d-bc70-2123781ff629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:05.778441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4f6e7-32c9-440d-bc70-2123781ff629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:05.780039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4f6e7-32c9-440d-bc70-2123781ff629 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:05.834360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 888/1790] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:06.330613 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eeb861-3996-488c-937a-b722b61a1185 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:06.332677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-54eeb861-3996-488c-937a-b722b61a1185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:06.479532 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54eeb861-3996-488c-937a-b722b61a1185 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:06.486816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17470994-ef8f-4b7e-914f-d460752c72eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:06.488945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17470994-ef8f-4b7e-914f-d460752c72eb service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:06.489382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17470994-ef8f-4b7e-914f-d460752c72eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:06.489864 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17470994-ef8f-4b7e-914f-d460752c72eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:06.492596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-17470994-ef8f-4b7e-914f-d460752c72eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:06.701588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17470994-ef8f-4b7e-914f-d460752c72eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:06.704169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17470994-ef8f-4b7e-914f-d460752c72eb service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:06.734137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 903/1791] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:06 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:07.748081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4f6e7-32c9-440d-bc70-2123781ff629 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:07.751628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-51b4f6e7-32c9-440d-bc70-2123781ff629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:07.779334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4f6e7-32c9-440d-bc70-2123781ff629 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:07.817368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:07.837093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:07.838671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:07.842086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] PATH_INFO: `/v3/projects/034ce3cfcc1644e595ee74dbfb8798b1` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:07.877034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] RBAC: Authorizing `identity:delete_project(project_id=034ce3cfcc1644e595ee74dbfb8798b1)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:07.897248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:08.069508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '034ce3cfcc1644e595ee74dbfb8798b1', 'request_id': 'req-fff00fbf-593b-49d4-b42c-aeb8b140e18f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:08.088247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '034ce3cfcc1644e595ee74dbfb8798b1', 'request_id': 'req-fff00fbf-593b-49d4-b42c-aeb8b140e18f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:08.127029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '034ce3cfcc1644e595ee74dbfb8798b1', 'request_id': 'req-fff00fbf-593b-49d4-b42c-aeb8b140e18f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:08.153055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] The token cache is being invalidate because project 034ce3cfcc1644e595ee74dbfb8798b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:08.153356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:08.155397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fff00fbf-593b-49d4-b42c-aeb8b140e18f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:08.161649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 889/1792] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:07 2022] DELETE /identity/v3/projects/034ce3cfcc1644e595ee74dbfb8798b1 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:08.163082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17470994-ef8f-4b7e-914f-d460752c72eb service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:08.178879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17470994-ef8f-4b7e-914f-d460752c72eb service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:08.345619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:08.346484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:08.348830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:08.350596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] PATH_INFO: `/v3/users/72eb1e045ca14b48aa40411bd044c8b8` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:08.357119 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=72eb1e045ca14b48aa40411bd044c8b8)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:08.360830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:08.372379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:08.490363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72eb1e045ca14b48aa40411bd044c8b8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:08.523397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72eb1e045ca14b48aa40411bd044c8b8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:08.536515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72eb1e045ca14b48aa40411bd044c8b8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:08.563704 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522de18-1bca-4d86-aa43-b55c038ef08f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:08.564007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522de18-1bca-4d86-aa43-b55c038ef08f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:08.564263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d522de18-1bca-4d86-aa43-b55c038ef08f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:08.565648 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 890/1793] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 21:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 18 21:06:08.567747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72eb1e045ca14b48aa40411bd044c8b8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:08.568788 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2bfe1f91-c3f3-411f-892e-91fff212dc1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72eb1e045ca14b48aa40411bd044c8b8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:08.586453 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 904/1794] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:08 2022] DELETE /identity/v3/users/72eb1e045ca14b48aa40411bd044c8b8 => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:08.819686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a32a9-c789-40ce-b7c6-f38db650c08e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:08.820360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a32a9-c789-40ce-b7c6-f38db650c08e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:08.820360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22a32a9-c789-40ce-b7c6-f38db650c08e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:08.862963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d22a32a9-c789-40ce-b7c6-f38db650c08e None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:08.864869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d22a32a9-c789-40ce-b7c6-f38db650c08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:08.974166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e098-af3b-4e0c-81c1-431d3abd0d6b None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:08.974453 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e098-af3b-4e0c-81c1-431d3abd0d6b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:08.974710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9155e098-af3b-4e0c-81c1-431d3abd0d6b None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:08.976367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 905/1795] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 21:06:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:08.991880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836d2c3-430e-4020-8179-55763d3cde66 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:08.992218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836d2c3-430e-4020-8179-55763d3cde66 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:08.992439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5836d2c3-430e-4020-8179-55763d3cde66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:09.029771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-5836d2c3-430e-4020-8179-55763d3cde66 None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:09.031187 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5836d2c3-430e-4020-8179-55763d3cde66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:09.203457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 906/1796] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:09.233043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 891/1797] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 21:06:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 414 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:09.696272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836d2c3-430e-4020-8179-55763d3cde66 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:09.697751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5836d2c3-430e-4020-8179-55763d3cde66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:09.917428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5836d2c3-430e-4020-8179-55763d3cde66 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:09.922674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:09.923414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:09.923710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:09.923970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] PATH_INFO: `/v3/projects/7478aeb00ce144259a8d1772315aaf9b` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:09.926876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7478aeb00ce144259a8d1772315aaf9b)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:09.931272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:09.979263 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:10.065204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7478aeb00ce144259a8d1772315aaf9b', 'request_id': 'req-e6258cd1-53d6-454c-a063-1049db92df8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:10.085794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7478aeb00ce144259a8d1772315aaf9b', 'request_id': 'req-e6258cd1-53d6-454c-a063-1049db92df8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:10.100108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7478aeb00ce144259a8d1772315aaf9b', 'request_id': 'req-e6258cd1-53d6-454c-a063-1049db92df8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:10.117906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a32a9-c789-40ce-b7c6-f38db650c08e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:10.119357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d22a32a9-c789-40ce-b7c6-f38db650c08e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:10.132043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] The token cache is being invalidate because project 7478aeb00ce144259a8d1772315aaf9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:10.133447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:10.134270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e6258cd1-53d6-454c-a063-1049db92df8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:10.139179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 907/1798] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:09 2022] DELETE /identity/v3/projects/7478aeb00ce144259a8d1772315aaf9b => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:10.144589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20245466-94a2-4a5b-815d-8e728690f7d6 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.144874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20245466-94a2-4a5b-815d-8e728690f7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.145224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20245466-94a2-4a5b-815d-8e728690f7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.154855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22a32a9-c789-40ce-b7c6-f38db650c08e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:10.180010 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:10.194882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-20245466-94a2-4a5b-815d-8e728690f7d6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:10.196236 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-20245466-94a2-4a5b-815d-8e728690f7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:10.321803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 908/1799] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:10.329936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3cb58-d6d3-4fe0-b4b6-35476c02eecc None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.330467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3cb58-d6d3-4fe0-b4b6-35476c02eecc None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.331466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3cb58-d6d3-4fe0-b4b6-35476c02eecc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.383765 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ada3cb58-d6d3-4fe0-b4b6-35476c02eecc None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:10.384146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b82054-3807-4a32-a0ba-c9d45418fb57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:10.385215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82054-3807-4a32-a0ba-c9d45418fb57 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.385634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ada3cb58-d6d3-4fe0-b4b6-35476c02eecc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:10.386093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82054-3807-4a32-a0ba-c9d45418fb57 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.386788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b82054-3807-4a32-a0ba-c9d45418fb57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.389532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-44b82054-3807-4a32-a0ba-c9d45418fb57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:10.417099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 909/1800] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:10.421581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b82054-3807-4a32-a0ba-c9d45418fb57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:10.421805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3cb58-d6d3-4fe0-b4b6-35476c02eecc None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:10.425631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b82054-3807-4a32-a0ba-c9d45418fb57 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:10.442246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3cb58-d6d3-4fe0-b4b6-35476c02eecc None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:10.455606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528c44c-1eff-4d7a-9cad-3fa14ed91be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:10.456977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 892/1801] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:10.458724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528c44c-1eff-4d7a-9cad-3fa14ed91be6 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.458994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528c44c-1eff-4d7a-9cad-3fa14ed91be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.460390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7528c44c-1eff-4d7a-9cad-3fa14ed91be6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.461133 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528c44c-1eff-4d7a-9cad-3fa14ed91be6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:10.462560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528c44c-1eff-4d7a-9cad-3fa14ed91be6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:10.465872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7528c44c-1eff-4d7a-9cad-3fa14ed91be6 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:10.519326 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 910/1802] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:06:10.521199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b82054-3807-4a32-a0ba-c9d45418fb57 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:10.539197 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b82054-3807-4a32-a0ba-c9d45418fb57 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:10.551009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26795237-5268-428a-9184-6cc9a9c4384b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:10.553261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26795237-5268-428a-9184-6cc9a9c4384b admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.554850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26795237-5268-428a-9184-6cc9a9c4384b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.558906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26795237-5268-428a-9184-6cc9a9c4384b admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.559465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26795237-5268-428a-9184-6cc9a9c4384b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:10.561831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26795237-5268-428a-9184-6cc9a9c4384b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:10.628370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528c44c-1eff-4d7a-9cad-3fa14ed91be6 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:10.641107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 893/1803] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:10 2022] POST /identity/v3/projects => generated 363 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:10.643174 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26795237-5268-428a-9184-6cc9a9c4384b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:10.645691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7528c44c-1eff-4d7a-9cad-3fa14ed91be6 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:10.648571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-26795237-5268-428a-9184-6cc9a9c4384b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:10.865619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359de5a7-e1c4-4fd5-8cc2-0933112fd88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:10.865619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359de5a7-e1c4-4fd5-8cc2-0933112fd88c admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.865619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359de5a7-e1c4-4fd5-8cc2-0933112fd88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.865619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359de5a7-e1c4-4fd5-8cc2-0933112fd88c admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.867535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359de5a7-e1c4-4fd5-8cc2-0933112fd88c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:10.880826 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359de5a7-e1c4-4fd5-8cc2-0933112fd88c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:10.923764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26795237-5268-428a-9184-6cc9a9c4384b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:10.939827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd220b9-94e3-4511-82a8-46eaf7a2d4ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:10.941755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd220b9-94e3-4511-82a8-46eaf7a2d4ec service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:10.941929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd220b9-94e3-4511-82a8-46eaf7a2d4ec service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:10.942887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd220b9-94e3-4511-82a8-46eaf7a2d4ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:10.947729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9cd220b9-94e3-4511-82a8-46eaf7a2d4ec service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:10.980267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 911/1804] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:10 2022] POST /identity/v3/users => generated 282 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:10.981992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359de5a7-e1c4-4fd5-8cc2-0933112fd88c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:10.990243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-359de5a7-e1c4-4fd5-8cc2-0933112fd88c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:11.012231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd220b9-94e3-4511-82a8-46eaf7a2d4ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:11.015443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd220b9-94e3-4511-82a8-46eaf7a2d4ec service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:11.043953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359de5a7-e1c4-4fd5-8cc2-0933112fd88c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:11.059013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 894/1805] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:11.062739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd220b9-94e3-4511-82a8-46eaf7a2d4ec service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:11.080148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:11.080838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:11.083097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:11.085077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] PATH_INFO: `/v3/users/a3b2c6226c174b1d9283adc33299c40c` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:11.088509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3b2c6226c174b1d9283adc33299c40c)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:11.095358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:11.104013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd220b9-94e3-4511-82a8-46eaf7a2d4ec service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:11.124408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252818b-7da3-42d2-9713-03357a62eb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:11.125174 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252818b-7da3-42d2-9713-03357a62eb12 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:11.125681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252818b-7da3-42d2-9713-03357a62eb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:11.128547 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252818b-7da3-42d2-9713-03357a62eb12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:11.129666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:11.131399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252818b-7da3-42d2-9713-03357a62eb12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:11.143137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0252818b-7da3-42d2-9713-03357a62eb12 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:11.188063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 895/1806] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:11.189278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252818b-7da3-42d2-9713-03357a62eb12 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:11.222134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252818b-7da3-42d2-9713-03357a62eb12 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:11.232386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f4f8b-b82c-44e8-a6ef-e6a66956abcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:11.233451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f4f8b-b82c-44e8-a6ef-e6a66956abcc admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:11.235380 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f4f8b-b82c-44e8-a6ef-e6a66956abcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:11.235911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2f4f8b-b82c-44e8-a6ef-e6a66956abcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:11.237546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f4f8b-b82c-44e8-a6ef-e6a66956abcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:11.246792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2f4f8b-b82c-44e8-a6ef-e6a66956abcc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:11.281010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3b2c6226c174b1d9283adc33299c40c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:11.285604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 896/1807] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:11 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:11.287703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f4f8b-b82c-44e8-a6ef-e6a66956abcc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:11.297246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3b2c6226c174b1d9283adc33299c40c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:11.317042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2f4f8b-b82c-44e8-a6ef-e6a66956abcc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:11.323279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3b2c6226c174b1d9283adc33299c40c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:11.328790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f992135-b515-4124-ad82-84f569bc7de7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:11.330973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f992135-b515-4124-ad82-84f569bc7de7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:11.331818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f992135-b515-4124-ad82-84f569bc7de7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:11.333512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f992135-b515-4124-ad82-84f569bc7de7 admin admin] PATH_INFO: `/v3/projects/de76d5bfe8ce490389766bb231bce73e/users/8fdddcd7d8c4408494b2e62e9825e786/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:11.337112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3b2c6226c174b1d9283adc33299c40c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:11.337873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f9257497-84bb-48ce-ad2f-450be890aead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3b2c6226c174b1d9283adc33299c40c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:11.347876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 912/1808] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:10 2022] DELETE /identity/v3/users/a3b2c6226c174b1d9283adc33299c40c => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:11.363771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20b845-f017-4a79-b5cb-1f285fe76a00 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:11.364899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20b845-f017-4a79-b5cb-1f285fe76a00 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:11.365538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c20b845-f017-4a79-b5cb-1f285fe76a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:11.370343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f992135-b515-4124-ad82-84f569bc7de7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de76d5bfe8ce490389766bb231bce73e, user_id=8fdddcd7d8c4408494b2e62e9825e786, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:11.378130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f992135-b515-4124-ad82-84f569bc7de7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:11.414049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 897/1809] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:11 2022] PUT /identity/v3/projects/de76d5bfe8ce490389766bb231bce73e/users/8fdddcd7d8c4408494b2e62e9825e786/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:11.416048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cdaf-f642-4f61-8ddd-269659c6b7a0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:11.421660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cdaf-f642-4f61-8ddd-269659c6b7a0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:11.422259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14cdaf-f642-4f61-8ddd-269659c6b7a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:11.423055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7c20b845-f017-4a79-b5cb-1f285fe76a00 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:11.424372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7c20b845-f017-4a79-b5cb-1f285fe76a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:11.470027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:11.486860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ef14cdaf-f642-4f61-8ddd-269659c6b7a0 None None] MFA Rules not processed for user `8fdddcd7d8c4408494b2e62e9825e786`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:11.489525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef14cdaf-f642-4f61-8ddd-269659c6b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:11.610970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 913/1810] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:11.650318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20b845-f017-4a79-b5cb-1f285fe76a00 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:11.652367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7c20b845-f017-4a79-b5cb-1f285fe76a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:11.670339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 898/1811] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:11.678711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14cdaf-f642-4f61-8ddd-269659c6b7a0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:11.683754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef14cdaf-f642-4f61-8ddd-269659c6b7a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:11.725843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14cdaf-f642-4f61-8ddd-269659c6b7a0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:11.739978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aabf0-89cc-48e5-b27c-3c65a8d17404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:11.742255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aabf0-89cc-48e5-b27c-3c65a8d17404 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:11.745267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aabf0-89cc-48e5-b27c-3c65a8d17404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:11.745661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759aabf0-89cc-48e5-b27c-3c65a8d17404 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:11.746551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aabf0-89cc-48e5-b27c-3c65a8d17404 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:11.767519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-759aabf0-89cc-48e5-b27c-3c65a8d17404 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:11.838415 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 899/1812] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:11 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:11.839580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aabf0-89cc-48e5-b27c-3c65a8d17404 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:11.995969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c20b845-f017-4a79-b5cb-1f285fe76a00 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:12.123763 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759aabf0-89cc-48e5-b27c-3c65a8d17404 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:12.141968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856eccf-f096-49ba-bfd7-04e1b7b92703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:12.144212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856eccf-f096-49ba-bfd7-04e1b7b92703 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.146356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856eccf-f096-49ba-bfd7-04e1b7b92703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.146812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856eccf-f096-49ba-bfd7-04e1b7b92703 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.147513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856eccf-f096-49ba-bfd7-04e1b7b92703 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:12.156376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856eccf-f096-49ba-bfd7-04e1b7b92703 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:12.178537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:12.209410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21473367-1a4c-445e-9c3d-f8cc04fb8d27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:12.211841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21473367-1a4c-445e-9c3d-f8cc04fb8d27 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.212647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21473367-1a4c-445e-9c3d-f8cc04fb8d27 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.213558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21473367-1a4c-445e-9c3d-f8cc04fb8d27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.233333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 900/1813] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:11 2022] POST /identity/v3/users => generated 288 bytes in 394 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:12.239699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856eccf-f096-49ba-bfd7-04e1b7b92703 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:12.245767 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c856eccf-f096-49ba-bfd7-04e1b7b92703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:12.247433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21473367-1a4c-445e-9c3d-f8cc04fb8d27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:12.249180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21473367-1a4c-445e-9c3d-f8cc04fb8d27 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:12.287482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856eccf-f096-49ba-bfd7-04e1b7b92703 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:12.288020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 914/1814] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 638 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:12.289727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21473367-1a4c-445e-9c3d-f8cc04fb8d27 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:12.303790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:12.304540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.305097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.305628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] PATH_INFO: `/v3/projects/ac1fb63bb9584d329031c29db9a7179d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.308814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac1fb63bb9584d329031c29db9a7179d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:12.317319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:12.320741 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21473367-1a4c-445e-9c3d-f8cc04fb8d27 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:12.335513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd107-4934-4c06-870c-b14418fc931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:12.338518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd107-4934-4c06-870c-b14418fc931c admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.338991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd107-4934-4c06-870c-b14418fc931c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.341102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93dbd107-4934-4c06-870c-b14418fc931c admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.343518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbd107-4934-4c06-870c-b14418fc931c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:12.347639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93dbd107-4934-4c06-870c-b14418fc931c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:12.377321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 915/1815] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:12.381818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd107-4934-4c06-870c-b14418fc931c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:12.416897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93dbd107-4934-4c06-870c-b14418fc931c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:12.458972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac1fb63bb9584d329031c29db9a7179d', 'request_id': 'req-9f36b578-58e4-43f9-a07a-b873d84301fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:12.474832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac1fb63bb9584d329031c29db9a7179d', 'request_id': 'req-9f36b578-58e4-43f9-a07a-b873d84301fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:12.498543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac1fb63bb9584d329031c29db9a7179d', 'request_id': 'req-9f36b578-58e4-43f9-a07a-b873d84301fe'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:12.504488 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:INSERT=5,keystone:DELETE=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:12.531382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] The token cache is being invalidate because project ac1fb63bb9584d329031c29db9a7179d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:12.533290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:12.535007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9f36b578-58e4-43f9-a07a-b873d84301fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:12.537965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 901/1816] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:12 2022] DELETE /identity/v3/projects/ac1fb63bb9584d329031c29db9a7179d => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:12.543999 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b35aa-554a-4fa8-bf16-64a1358583c2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.544401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b35aa-554a-4fa8-bf16-64a1358583c2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.544964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b35aa-554a-4fa8-bf16-64a1358583c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.570031 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0080d-22b4-44b9-b25e-fea413df89e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:12.571055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0080d-22b4-44b9-b25e-fea413df89e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.571425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0080d-22b4-44b9-b25e-fea413df89e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.571734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f0080d-22b4-44b9-b25e-fea413df89e1 admin admin] PATH_INFO: `/v3/projects/ed93f9f63d044af888cc89a2723b668f/users/2c2cbb10ec40462da9ecfdf3cf03e583/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.593385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0080d-22b4-44b9-b25e-fea413df89e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed93f9f63d044af888cc89a2723b668f, user_id=2c2cbb10ec40462da9ecfdf3cf03e583, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:12.596639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f0080d-22b4-44b9-b25e-fea413df89e1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:12.603421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-666b35aa-554a-4fa8-bf16-64a1358583c2 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:12.607962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-666b35aa-554a-4fa8-bf16-64a1358583c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:12.621037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 916/1817] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:12 2022] PUT /identity/v3/projects/ed93f9f63d044af888cc89a2723b668f/users/2c2cbb10ec40462da9ecfdf3cf03e583/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:12.627055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0080d-22b4-44b9-b25e-fea413df89e1 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:12.630428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e4f0080d-22b4-44b9-b25e-fea413df89e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:12.743772 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 902/1818] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:12.755130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38ecb3-122e-4090-aeba-88052449d7e6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.755680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38ecb3-122e-4090-aeba-88052449d7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.756116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb38ecb3-122e-4090-aeba-88052449d7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.822318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f0080d-22b4-44b9-b25e-fea413df89e1 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:12.828517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cb38ecb3-122e-4090-aeba-88052449d7e6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:12.833143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cb38ecb3-122e-4090-aeba-88052449d7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:12.837776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06267bbf-abfb-423a-9bde-95f44144c69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:12.841739 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267bbf-abfb-423a-9bde-95f44144c69e admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.842039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267bbf-abfb-423a-9bde-95f44144c69e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.842993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06267bbf-abfb-423a-9bde-95f44144c69e admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.845479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06267bbf-abfb-423a-9bde-95f44144c69e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:12.858991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 903/1819] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:12.864154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38ecb3-122e-4090-aeba-88052449d7e6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:12.870198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06267bbf-abfb-423a-9bde-95f44144c69e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:12.889458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb38ecb3-122e-4090-aeba-88052449d7e6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:12.903014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c034d-fe56-4b61-bd26-3045beccd0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:12.903731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c034d-fe56-4b61-bd26-3045beccd0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.904049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c034d-fe56-4b61-bd26-3045beccd0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.905718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c034d-fe56-4b61-bd26-3045beccd0a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.907981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c034d-fe56-4b61-bd26-3045beccd0a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:12.908158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c034d-fe56-4b61-bd26-3045beccd0a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:12.913178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 917/1820] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:12.913357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c034d-fe56-4b61-bd26-3045beccd0a4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:12.915856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06267bbf-abfb-423a-9bde-95f44144c69e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:12.945515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 904/1821] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:06:12.948781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c034d-fe56-4b61-bd26-3045beccd0a4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:12.953850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06267bbf-abfb-423a-9bde-95f44144c69e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:12.970679 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccf466-09e8-42ad-baf7-468d3074639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:12.972241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccf466-09e8-42ad-baf7-468d3074639a admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.972533 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccf466-09e8-42ad-baf7-468d3074639a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.972647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c034d-fe56-4b61-bd26-3045beccd0a4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:12.972828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccf466-09e8-42ad-baf7-468d3074639a admin admin] PATH_INFO: `/v3/projects/ed93f9f63d044af888cc89a2723b668f/users/2c2cbb10ec40462da9ecfdf3cf03e583/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.982900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccf466-09e8-42ad-baf7-468d3074639a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed93f9f63d044af888cc89a2723b668f, user_id=2c2cbb10ec40462da9ecfdf3cf03e583, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:12.987283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e401e-a00a-4648-9a16-b030248c6b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:12.987939 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e401e-a00a-4648-9a16-b030248c6b3f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:12.988215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e401e-a00a-4648-9a16-b030248c6b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:12.988479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e401e-a00a-4648-9a16-b030248c6b3f admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:12.989118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e401e-a00a-4648-9a16-b030248c6b3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:12.989223 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccf466-09e8-42ad-baf7-468d3074639a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:12.993126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1e401e-a00a-4648-9a16-b030248c6b3f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:13.030621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 918/1822] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:12 2022] PUT /identity/v3/projects/ed93f9f63d044af888cc89a2723b668f/users/2c2cbb10ec40462da9ecfdf3cf03e583/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:13.047098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144e69-95ec-4127-b2d0-bbb02933bb04 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:13.047406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144e69-95ec-4127-b2d0-bbb02933bb04 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:13.047656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50144e69-95ec-4127-b2d0-bbb02933bb04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:13.107532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 905/1823] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:12 2022] POST /identity/v3/projects => generated 401 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:13.113155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e401e-a00a-4648-9a16-b030248c6b3f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:13.161156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-50144e69-95ec-4127-b2d0-bbb02933bb04 None None] MFA Rules not processed for user `2c2cbb10ec40462da9ecfdf3cf03e583`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:13.162877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-50144e69-95ec-4127-b2d0-bbb02933bb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:13.300991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:13.354664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e401e-a00a-4648-9a16-b030248c6b3f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:13.365912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5561aa2-afbf-4323-b7b7-632ac9b95669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:13.366541 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561aa2-afbf-4323-b7b7-632ac9b95669 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:13.366849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561aa2-afbf-4323-b7b7-632ac9b95669 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:13.367121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5561aa2-afbf-4323-b7b7-632ac9b95669 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:13.367764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5561aa2-afbf-4323-b7b7-632ac9b95669 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:13.369823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5561aa2-afbf-4323-b7b7-632ac9b95669 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:13.413799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 919/1824] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:13.427417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 906/1825] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:13 2022] POST /identity/v3/users => generated 301 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:13.428958 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50144e69-95ec-4127-b2d0-bbb02933bb04 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:13.430842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-50144e69-95ec-4127-b2d0-bbb02933bb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:13.432040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5561aa2-afbf-4323-b7b7-632ac9b95669 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:13.464771 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5561aa2-afbf-4323-b7b7-632ac9b95669 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:13.480479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b320-1d20-4c4d-ae5f-f0fe172f2bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:13.481756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b320-1d20-4c4d-ae5f-f0fe172f2bdd admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:13.483981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b320-1d20-4c4d-ae5f-f0fe172f2bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:13.484417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9357b320-1d20-4c4d-ae5f-f0fe172f2bdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:13.487216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357b320-1d20-4c4d-ae5f-f0fe172f2bdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:13.492772 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9357b320-1d20-4c4d-ae5f-f0fe172f2bdd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:13.520593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 907/1826] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:13.525177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b320-1d20-4c4d-ae5f-f0fe172f2bdd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:13.549710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9357b320-1d20-4c4d-ae5f-f0fe172f2bdd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:13.562075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50144e69-95ec-4127-b2d0-bbb02933bb04 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:13.567213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933052-39fa-4d18-beea-65ce4dbad3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:13.568004 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933052-39fa-4d18-beea-65ce4dbad3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:13.568387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933052-39fa-4d18-beea-65ce4dbad3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:13.568760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c933052-39fa-4d18-beea-65ce4dbad3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:13.570145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a159b6-455f-4ea6-822e-5f32a78e146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:13.573778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a159b6-455f-4ea6-822e-5f32a78e146c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:13.574485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a159b6-455f-4ea6-822e-5f32a78e146c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:13.576996 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a159b6-455f-4ea6-822e-5f32a78e146c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:13.592236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a159b6-455f-4ea6-822e-5f32a78e146c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:13.597752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a159b6-455f-4ea6-822e-5f32a78e146c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:13.599436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c933052-39fa-4d18-beea-65ce4dbad3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:13.601030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c933052-39fa-4d18-beea-65ce4dbad3f0 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:13.620705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 920/1827] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:13 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:13.638275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 908/1828] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:13 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:13.638808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933052-39fa-4d18-beea-65ce4dbad3f0 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:13.660820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c933052-39fa-4d18-beea-65ce4dbad3f0 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:13.667131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eeb77-9694-4024-849d-a14a190772cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:13.667952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eeb77-9694-4024-849d-a14a190772cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:13.668381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eeb77-9694-4024-849d-a14a190772cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:13.668732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0eeb77-9694-4024-849d-a14a190772cf admin admin] PATH_INFO: `/v3/projects/f0697dfcf1034bbdbffd793a6ff392e9/users/06a2b2e188354fb6938942df20c43148/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:13.708780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eeb77-9694-4024-849d-a14a190772cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0697dfcf1034bbdbffd793a6ff392e9, user_id=06a2b2e188354fb6938942df20c43148, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:13.711923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0eeb77-9694-4024-849d-a14a190772cf admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:13.731941 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 921/1829] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:13 2022] PUT /identity/v3/projects/f0697dfcf1034bbdbffd793a6ff392e9/users/06a2b2e188354fb6938942df20c43148/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:13.743116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73d9f0-3ba1-447e-92bd-0eff3afd84c2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:13.743358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73d9f0-3ba1-447e-92bd-0eff3afd84c2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:13.743603 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a73d9f0-3ba1-447e-92bd-0eff3afd84c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:13.840453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0a73d9f0-3ba1-447e-92bd-0eff3afd84c2 None None] MFA Rules not processed for user `06a2b2e188354fb6938942df20c43148`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:13.842020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0a73d9f0-3ba1-447e-92bd-0eff3afd84c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:13.854571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:DELETE=1,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:14.044235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 909/1830] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:13 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:14.049673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eeb77-9694-4024-849d-a14a190772cf admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:14.208416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0eeb77-9694-4024-849d-a14a190772cf admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:14.214485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66991b1-6eec-45a7-afc7-b9a75314471f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:14.215411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66991b1-6eec-45a7-afc7-b9a75314471f admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:14.215887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66991b1-6eec-45a7-afc7-b9a75314471f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:14.216368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66991b1-6eec-45a7-afc7-b9a75314471f admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:14.217603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66991b1-6eec-45a7-afc7-b9a75314471f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:14.220103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66991b1-6eec-45a7-afc7-b9a75314471f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:14.293272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73d9f0-3ba1-447e-92bd-0eff3afd84c2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:14.293272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0a73d9f0-3ba1-447e-92bd-0eff3afd84c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:14.299493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a73d9f0-3ba1-447e-92bd-0eff3afd84c2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:14.304256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 922/1831] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:14 2022] POST /identity/v3/projects => generated 401 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:14.305770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:14.306417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:14.306693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:14.307091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] PATH_INFO: `/v3/projects/380d8b0930694234af750923a248547a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:14.308226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=380d8b0930694234af750923a248547a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:14.310260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:14.315174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66991b1-6eec-45a7-afc7-b9a75314471f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:14.360280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:14.409801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '380d8b0930694234af750923a248547a', 'request_id': 'req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.427613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '380d8b0930694234af750923a248547a', 'request_id': 'req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.439831 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66991b1-6eec-45a7-afc7-b9a75314471f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:14.441669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '380d8b0930694234af750923a248547a', 'request_id': 'req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.464423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] The token cache is being invalidate because project 380d8b0930694234af750923a248547a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:14.464675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.465529 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.467323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 910/1832] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:14 2022] DELETE /identity/v3/projects/380d8b0930694234af750923a248547a => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:14.471465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:14.473136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:14.543209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525762a5-8142-4ed5-974b-f1004ab72d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:14.544205 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525762a5-8142-4ed5-974b-f1004ab72d16 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:14.544487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525762a5-8142-4ed5-974b-f1004ab72d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:14.545047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525762a5-8142-4ed5-974b-f1004ab72d16 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:14.546208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525762a5-8142-4ed5-974b-f1004ab72d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:14.548754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525762a5-8142-4ed5-974b-f1004ab72d16 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:14.569200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751f6c8b-68b1-4feb-b5e8-4c92fe6d16bb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:14.576284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:14.576938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:14.577291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:14.577593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] PATH_INFO: `/v3/users/e186365d4a354bf1a2cf9c0ae2990273` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:14.578061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 923/1833] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:14 2022] POST /identity/v3/users => generated 307 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:14.578791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525762a5-8142-4ed5-974b-f1004ab72d16 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:14.579141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e186365d4a354bf1a2cf9c0ae2990273)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:14.580682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-525762a5-8142-4ed5-974b-f1004ab72d16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:14.581283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:14.593740 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525762a5-8142-4ed5-974b-f1004ab72d16 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:14.600751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:14.601390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:14.601670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:14.601939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] PATH_INFO: `/v3/users/8fdddcd7d8c4408494b2e62e9825e786` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:14.603235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fdddcd7d8c4408494b2e62e9825e786)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:14.605401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:14.624008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:14.639081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e186365d4a354bf1a2cf9c0ae2990273'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.640145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e186365d4a354bf1a2cf9c0ae2990273'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.641225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e186365d4a354bf1a2cf9c0ae2990273'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.665052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fdddcd7d8c4408494b2e62e9825e786'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.676656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e186365d4a354bf1a2cf9c0ae2990273'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.684595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fdddcd7d8c4408494b2e62e9825e786'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.690675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e186365d4a354bf1a2cf9c0ae2990273'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.694635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fdddcd7d8c4408494b2e62e9825e786'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.705248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fdddcd7d8c4408494b2e62e9825e786'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.706093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-472e1033-0ca7-4da6-aab2-f0dc0121a6c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fdddcd7d8c4408494b2e62e9825e786'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:14.708271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 911/1834] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:14 2022] DELETE /identity/v3/users/e186365d4a354bf1a2cf9c0ae2990273 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:14.709251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:14.710815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:14.717462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 924/1835] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:14 2022] DELETE /identity/v3/users/8fdddcd7d8c4408494b2e62e9825e786 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:14.719007 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498c89-8396-49a0-91a2-c4b572196b07 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:14.719298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498c89-8396-49a0-91a2-c4b572196b07 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:14.719572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0498c89-8396-49a0-91a2-c4b572196b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:14.753759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-b0498c89-8396-49a0-91a2-c4b572196b07 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:14.758149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b0498c89-8396-49a0-91a2-c4b572196b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:14.795128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70a00-bd37-4839-8790-6ff47b5e8424 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:14.804481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:14.864223 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 925/1836] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:14.872499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe02b50-53cb-4a72-9f9f-c505aab7f846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:14.873496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe02b50-53cb-4a72-9f9f-c505aab7f846 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:14.873774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe02b50-53cb-4a72-9f9f-c505aab7f846 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:14.874034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe02b50-53cb-4a72-9f9f-c505aab7f846 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:14.875442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe02b50-53cb-4a72-9f9f-c505aab7f846 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:14.876745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe02b50-53cb-4a72-9f9f-c505aab7f846 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:14.890909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 912/1837] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:14.892501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0498c89-8396-49a0-91a2-c4b572196b07 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:14.895791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b0498c89-8396-49a0-91a2-c4b572196b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:14.908153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0498c89-8396-49a0-91a2-c4b572196b07 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:14.912888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae64e-83f9-4e73-a124-9d189721c467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:14.913946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae64e-83f9-4e73-a124-9d189721c467 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:14.913946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae64e-83f9-4e73-a124-9d189721c467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:14.914218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056ae64e-83f9-4e73-a124-9d189721c467 admin admin] PATH_INFO: `/v3/projects/9c0806e033804f85900bc5cf5b1d41b9/users/cb0f105016da40a3a071bad249b7f91f/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:14.916023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe02b50-53cb-4a72-9f9f-c505aab7f846 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:14.918561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cbe02b50-53cb-4a72-9f9f-c505aab7f846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:14.950045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae64e-83f9-4e73-a124-9d189721c467 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0806e033804f85900bc5cf5b1d41b9, user_id=cb0f105016da40a3a071bad249b7f91f, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:14.953101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056ae64e-83f9-4e73-a124-9d189721c467 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:14.983885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 926/1838] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:14 2022] PUT /identity/v3/projects/9c0806e033804f85900bc5cf5b1d41b9/users/cb0f105016da40a3a071bad249b7f91f/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:14.985729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae64e-83f9-4e73-a124-9d189721c467 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:15.019409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe02b50-53cb-4a72-9f9f-c505aab7f846 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:15.024353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:15.087605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056ae64e-83f9-4e73-a124-9d189721c467 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:15.092648 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82ea59-3368-42df-a9ac-cafccaafdebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:15.093317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82ea59-3368-42df-a9ac-cafccaafdebf admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:15.093552 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82ea59-3368-42df-a9ac-cafccaafdebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:15.093819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae82ea59-3368-42df-a9ac-cafccaafdebf admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:15.094674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82ea59-3368-42df-a9ac-cafccaafdebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:15.094863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66636a79-ed20-44d5-a9d8-875e7625bb6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:15.095577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636a79-ed20-44d5-a9d8-875e7625bb6d service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:15.096094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636a79-ed20-44d5-a9d8-875e7625bb6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:15.096333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae82ea59-3368-42df-a9ac-cafccaafdebf admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:15.096422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66636a79-ed20-44d5-a9d8-875e7625bb6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:15.108043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 927/1839] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:14 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:15.111333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66636a79-ed20-44d5-a9d8-875e7625bb6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:15.112105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82ea59-3368-42df-a9ac-cafccaafdebf admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:15.112935 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66636a79-ed20-44d5-a9d8-875e7625bb6d service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:15.123563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae82ea59-3368-42df-a9ac-cafccaafdebf admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:15.124866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 913/1840] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:15.128781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4179-7d2c-42a7-827c-7b97d7d34e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:15.129527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4179-7d2c-42a7-827c-7b97d7d34e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:15.129808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4179-7d2c-42a7-827c-7b97d7d34e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:15.130081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ce4179-7d2c-42a7-827c-7b97d7d34e42 admin admin] PATH_INFO: `/v3/projects/9c0806e033804f85900bc5cf5b1d41b9/users/cb0f105016da40a3a071bad249b7f91f/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:15.132122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4179-7d2c-42a7-827c-7b97d7d34e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c0806e033804f85900bc5cf5b1d41b9, user_id=cb0f105016da40a3a071bad249b7f91f, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:15.134902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ce4179-7d2c-42a7-827c-7b97d7d34e42 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:15.147671 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 928/1841] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:15 2022] PUT /identity/v3/projects/9c0806e033804f85900bc5cf5b1d41b9/users/cb0f105016da40a3a071bad249b7f91f/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:15.159303 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78c79f-c32d-45ca-bcee-df35fdbbaa63 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:15.159588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78c79f-c32d-45ca-bcee-df35fdbbaa63 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:15.159861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b78c79f-c32d-45ca-bcee-df35fdbbaa63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:15.191489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2b78c79f-c32d-45ca-bcee-df35fdbbaa63 None None] MFA Rules not processed for user `cb0f105016da40a3a071bad249b7f91f`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:15.192716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2b78c79f-c32d-45ca-bcee-df35fdbbaa63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:15.280384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 914/1842] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:15 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:15.292158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4179-7d2c-42a7-827c-7b97d7d34e42 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:15.295367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-78ce4179-7d2c-42a7-827c-7b97d7d34e42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:15.387812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ce4179-7d2c-42a7-827c-7b97d7d34e42 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:15.392527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6c5e5-a1a1-4e7c-9886-97432eab33ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:15.393199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6c5e5-a1a1-4e7c-9886-97432eab33ab service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:15.393505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6c5e5-a1a1-4e7c-9886-97432eab33ab service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:15.394116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6c5e5-a1a1-4e7c-9886-97432eab33ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:15.409748 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6c5e5-a1a1-4e7c-9886-97432eab33ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:15.412306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6c5e5-a1a1-4e7c-9886-97432eab33ab service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:15.427411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 929/1843] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:15 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:15.529288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78c79f-c32d-45ca-bcee-df35fdbbaa63 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:15.540441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b78c79f-c32d-45ca-bcee-df35fdbbaa63 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:15.557991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7335ca-1392-4540-b5ac-602099324bf7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:15.558850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7335ca-1392-4540-b5ac-602099324bf7 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:15.559261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7335ca-1392-4540-b5ac-602099324bf7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:15.559628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7335ca-1392-4540-b5ac-602099324bf7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:15.563422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0c7335ca-1392-4540-b5ac-602099324bf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:15.619823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6c5e5-a1a1-4e7c-9886-97432eab33ab service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:15.621386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b8e6c5e5-a1a1-4e7c-9886-97432eab33ab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:15.688125 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7335ca-1392-4540-b5ac-602099324bf7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:15.690192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7335ca-1392-4540-b5ac-602099324bf7 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:15.701576 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 915/1844] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:15 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:15.709979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:15.732956 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7335ca-1392-4540-b5ac-602099324bf7 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:15.734741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0c7335ca-1392-4540-b5ac-602099324bf7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:15.770725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6c5e5-a1a1-4e7c-9886-97432eab33ab service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:15.780941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7335ca-1392-4540-b5ac-602099324bf7 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:15.790204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:15.791181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:15.791808 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:15.792302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] PATH_INFO: `/v3/projects/de76d5bfe8ce490389766bb231bce73e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:15.796926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=de76d5bfe8ce490389766bb231bce73e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:15.800768 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:15.811510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:15.812244 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:15.812443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:15.812736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] PATH_INFO: `/v3/projects/a62d7c356c9745f8abf0e61dfeb949ab` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:15.825441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a62d7c356c9745f8abf0e61dfeb949ab)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:15.828295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:15.857736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:15.874528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de76d5bfe8ce490389766bb231bce73e', 'request_id': 'req-a6b621f6-4915-4f42-af4f-944cade772bc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:15.884202 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a62d7c356c9745f8abf0e61dfeb949ab', 'request_id': 'req-8a341968-7658-412b-839b-f663c1464516'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:15.884466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de76d5bfe8ce490389766bb231bce73e', 'request_id': 'req-a6b621f6-4915-4f42-af4f-944cade772bc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:15.890665 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a62d7c356c9745f8abf0e61dfeb949ab', 'request_id': 'req-8a341968-7658-412b-839b-f663c1464516'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:15.894501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de76d5bfe8ce490389766bb231bce73e', 'request_id': 'req-a6b621f6-4915-4f42-af4f-944cade772bc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:15.901141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a62d7c356c9745f8abf0e61dfeb949ab', 'request_id': 'req-8a341968-7658-412b-839b-f663c1464516'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:15.910615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] The token cache is being invalidate because project de76d5bfe8ce490389766bb231bce73e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:15.910615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:15.911339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:15.913315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 916/1845] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:15 2022] DELETE /identity/v3/projects/de76d5bfe8ce490389766bb231bce73e => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:15.918407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:15.919840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] The token cache is being invalidate because project a62d7c356c9745f8abf0e61dfeb949ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:15.920748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:15.921469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:15.922186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:15.924495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 930/1846] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:15 2022] DELETE /identity/v3/projects/a62d7c356c9745f8abf0e61dfeb949ab => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:15.928476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:15.930537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:15.997155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b621f6-4915-4f42-af4f-944cade772bc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:16.015850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a341968-7658-412b-839b-f663c1464516 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:16.032331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:16.033335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:16.033495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:16.033908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] PATH_INFO: `/v3/users/ba7bb5074272483688230bcebec6d64f` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:16.035147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba7bb5074272483688230bcebec6d64f)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:16.037071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:16.089078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:16.089930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:16.090209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:16.090482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] PATH_INFO: `/v3/users/2c2cbb10ec40462da9ecfdf3cf03e583` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:16.092317 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c2cbb10ec40462da9ecfdf3cf03e583)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:16.095594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:16.112755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba7bb5074272483688230bcebec6d64f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.137127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba7bb5074272483688230bcebec6d64f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.149752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba7bb5074272483688230bcebec6d64f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.153615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:16.164595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba7bb5074272483688230bcebec6d64f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.165699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba7bb5074272483688230bcebec6d64f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.173553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 931/1847] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:15 2022] DELETE /identity/v3/users/ba7bb5074272483688230bcebec6d64f => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:16.193193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c2cbb10ec40462da9ecfdf3cf03e583'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.193995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c2cbb10ec40462da9ecfdf3cf03e583'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.194637 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c2cbb10ec40462da9ecfdf3cf03e583'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.209581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c2cbb10ec40462da9ecfdf3cf03e583'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.212766 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:16.219821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c2cbb10ec40462da9ecfdf3cf03e583'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.239252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 917/1848] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:15 2022] DELETE /identity/v3/users/2c2cbb10ec40462da9ecfdf3cf03e583 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:16.552393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:16.553908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:16.633633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f07558-18a0-4214-88e5-b1739fff2a30 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:16.663204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:16.665044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:16.719150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:16.720194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:16.720627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:16.721135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] PATH_INFO: `/v3/projects/403517970fbb40a9803969eb6b495806` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:16.722565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=403517970fbb40a9803969eb6b495806)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:16.724956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:16.751059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb21b9-33fc-437e-ae02-3e795709f667 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:16.777069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:16.778881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:16.780629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:16.780942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] PATH_INFO: `/v3/projects/ed93f9f63d044af888cc89a2723b668f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:16.782238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed93f9f63d044af888cc89a2723b668f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:16.784262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:16.805682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403517970fbb40a9803969eb6b495806', 'request_id': 'req-78250e07-f4ed-4575-9365-11542b731b42'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.812687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403517970fbb40a9803969eb6b495806', 'request_id': 'req-78250e07-f4ed-4575-9365-11542b731b42'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.826055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403517970fbb40a9803969eb6b495806', 'request_id': 'req-78250e07-f4ed-4575-9365-11542b731b42'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.844091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed93f9f63d044af888cc89a2723b668f', 'request_id': 'req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.850523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] The token cache is being invalidate because project 403517970fbb40a9803969eb6b495806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:16.851063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.851962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-78250e07-f4ed-4575-9365-11542b731b42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.853755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 932/1849] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:16 2022] DELETE /identity/v3/projects/403517970fbb40a9803969eb6b495806 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:16.855283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed93f9f63d044af888cc89a2723b668f', 'request_id': 'req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.860447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a50e1b-1ae5-465b-9bb8-7cd65905eb84 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:16.860891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a50e1b-1ae5-465b-9bb8-7cd65905eb84 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:16.861352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a50e1b-1ae5-465b-9bb8-7cd65905eb84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:16.874393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed93f9f63d044af888cc89a2723b668f', 'request_id': 'req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.904635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] The token cache is being invalidate because project ed93f9f63d044af888cc89a2723b668f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:16.905561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.908271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-31b74cbb-9a16-4a6e-8b7a-9693b71d5f38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:16.913779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 918/1850] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:16 2022] DELETE /identity/v3/projects/ed93f9f63d044af888cc89a2723b668f => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:16.915236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae3b8-7bf5-4a9f-8697-652a94a6cfa4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:16.915526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae3b8-7bf5-4a9f-8697-652a94a6cfa4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:16.915832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fae3b8-7bf5-4a9f-8697-652a94a6cfa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:16.929960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d2a50e1b-1ae5-465b-9bb8-7cd65905eb84 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:16.931524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d2a50e1b-1ae5-465b-9bb8-7cd65905eb84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:16.961328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-72fae3b8-7bf5-4a9f-8697-652a94a6cfa4 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:16.962558 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-72fae3b8-7bf5-4a9f-8697-652a94a6cfa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:16.969313 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:17.031092 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 933/1851] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:17.040237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f669479-5785-457a-ac0b-1d73610cbbf9 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.040715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f669479-5785-457a-ac0b-1d73610cbbf9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.041179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f669479-5785-457a-ac0b-1d73610cbbf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.053959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 919/1852] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:17.061874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148238a-b106-4bd7-9b75-1f8eb145f82d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.062561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148238a-b106-4bd7-9b75-1f8eb145f82d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.062660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148238a-b106-4bd7-9b75-1f8eb145f82d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.065725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-5f669479-5785-457a-ac0b-1d73610cbbf9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:17.067040 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5f669479-5785-457a-ac0b-1d73610cbbf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:17.086169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 934/1853] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:17.086448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5148238a-b106-4bd7-9b75-1f8eb145f82d None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:17.087908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5148238a-b106-4bd7-9b75-1f8eb145f82d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:17.090404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f669479-5785-457a-ac0b-1d73610cbbf9 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.097042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 920/1854] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:17.100737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f669479-5785-457a-ac0b-1d73610cbbf9 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.101120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148238a-b106-4bd7-9b75-1f8eb145f82d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.105407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a4649-a689-4bf8-a8b5-7b52f3ce09f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.106044 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a4649-a689-4bf8-a8b5-7b52f3ce09f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.106340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a4649-a689-4bf8-a8b5-7b52f3ce09f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.106591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a4649-a689-4bf8-a8b5-7b52f3ce09f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.107664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a4649-a689-4bf8-a8b5-7b52f3ce09f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:17.107981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a4649-a689-4bf8-a8b5-7b52f3ce09f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.109629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a4649-a689-4bf8-a8b5-7b52f3ce09f8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.110968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148238a-b106-4bd7-9b75-1f8eb145f82d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.115813 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212f56f-f5ec-4f74-9622-b1e096342534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.116428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f56f-f5ec-4f74-9622-b1e096342534 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.116709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f56f-f5ec-4f74-9622-b1e096342534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.116979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f56f-f5ec-4f74-9622-b1e096342534 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.117683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212f56f-f5ec-4f74-9622-b1e096342534 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:17.117988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212f56f-f5ec-4f74-9622-b1e096342534 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.119674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a212f56f-f5ec-4f74-9622-b1e096342534 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.122261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 935/1855] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:06:17.122915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:17.128149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a4649-a689-4bf8-a8b5-7b52f3ce09f8 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.137972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a4649-a689-4bf8-a8b5-7b52f3ce09f8 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.143545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 921/1856] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:06:17.144985 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212f56f-f5ec-4f74-9622-b1e096342534 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.147507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b0a96-9505-4b2c-94b2-326e71801fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.148139 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b0a96-9505-4b2c-94b2-326e71801fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.148419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b0a96-9505-4b2c-94b2-326e71801fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.148903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377b0a96-9505-4b2c-94b2-326e71801fbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.149541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b0a96-9505-4b2c-94b2-326e71801fbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.151609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377b0a96-9505-4b2c-94b2-326e71801fbf admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.156765 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a212f56f-f5ec-4f74-9622-b1e096342534 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.161996 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772880ba-b69a-42ce-89d7-d4d00b4cb0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.162827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772880ba-b69a-42ce-89d7-d4d00b4cb0c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.163200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772880ba-b69a-42ce-89d7-d4d00b4cb0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.163548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772880ba-b69a-42ce-89d7-d4d00b4cb0c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.164249 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772880ba-b69a-42ce-89d7-d4d00b4cb0c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.166237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772880ba-b69a-42ce-89d7-d4d00b4cb0c0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.182254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 936/1857] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:17.187239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b0a96-9505-4b2c-94b2-326e71801fbf admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.214198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 922/1858] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/projects => generated 365 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:17.218071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772880ba-b69a-42ce-89d7-d4d00b4cb0c0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.271479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377b0a96-9505-4b2c-94b2-326e71801fbf admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.288474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772880ba-b69a-42ce-89d7-d4d00b4cb0c0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.293601 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4bcb2-9cac-42ee-841b-5145d567610b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.294491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4bcb2-9cac-42ee-841b-5145d567610b admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.294491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4bcb2-9cac-42ee-841b-5145d567610b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.294872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f4bcb2-9cac-42ee-841b-5145d567610b admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.295510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4bcb2-9cac-42ee-841b-5145d567610b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.297614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f4bcb2-9cac-42ee-841b-5145d567610b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.324126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 923/1859] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/users => generated 283 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:17.328644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4bcb2-9cac-42ee-841b-5145d567610b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.340976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d3b0f-b92b-4b4a-a2b1-05aef1fbfe11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.341693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d3b0f-b92b-4b4a-a2b1-05aef1fbfe11 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.341980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d3b0f-b92b-4b4a-a2b1-05aef1fbfe11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.342248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896d3b0f-b92b-4b4a-a2b1-05aef1fbfe11 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.342860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f4bcb2-9cac-42ee-841b-5145d567610b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.342970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d3b0f-b92b-4b4a-a2b1-05aef1fbfe11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.345087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896d3b0f-b92b-4b4a-a2b1-05aef1fbfe11 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.348969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6914a-f7ab-43d7-af9b-c6dff6644d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.351102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6914a-f7ab-43d7-af9b-c6dff6644d00 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.351405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6914a-f7ab-43d7-af9b-c6dff6644d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.351686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e6914a-f7ab-43d7-af9b-c6dff6644d00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.352745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6914a-f7ab-43d7-af9b-c6dff6644d00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.355750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e6914a-f7ab-43d7-af9b-c6dff6644d00 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.371663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 937/1860] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/users => generated 286 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:17.371848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 924/1861] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:17.372843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d3b0f-b92b-4b4a-a2b1-05aef1fbfe11 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.375569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6914a-f7ab-43d7-af9b-c6dff6644d00 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.386807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e6914a-f7ab-43d7-af9b-c6dff6644d00 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.389782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896d3b0f-b92b-4b4a-a2b1-05aef1fbfe11 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.393492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8180ce0-3a8c-4426-85ff-4a622e0b13a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.394078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8180ce0-3a8c-4426-85ff-4a622e0b13a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.396420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8180ce0-3a8c-4426-85ff-4a622e0b13a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.396759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8180ce0-3a8c-4426-85ff-4a622e0b13a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.397372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8180ce0-3a8c-4426-85ff-4a622e0b13a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.398879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a480c0-084d-4a18-a238-1e458c92c0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.399505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8180ce0-3a8c-4426-85ff-4a622e0b13a6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.399890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a480c0-084d-4a18-a238-1e458c92c0d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.400275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a480c0-084d-4a18-a238-1e458c92c0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.400711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a480c0-084d-4a18-a238-1e458c92c0d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.401640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a480c0-084d-4a18-a238-1e458c92c0d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.404973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a480c0-084d-4a18-a238-1e458c92c0d1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.414942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 925/1862] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:17.417784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8180ce0-3a8c-4426-85ff-4a622e0b13a6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.423589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 938/1863] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:17.424616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a480c0-084d-4a18-a238-1e458c92c0d1 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.438199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a480c0-084d-4a18-a238-1e458c92c0d1 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.439961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8180ce0-3a8c-4426-85ff-4a622e0b13a6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.443789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd23d8b0-d65d-478f-9a6d-21e40bbad468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.444707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23d8b0-d65d-478f-9a6d-21e40bbad468 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.444823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fafa91-3397-422e-add7-c79aece656f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.445186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23d8b0-d65d-478f-9a6d-21e40bbad468 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.445331 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fafa91-3397-422e-add7-c79aece656f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.445615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fafa91-3397-422e-add7-c79aece656f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.445760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd23d8b0-d65d-478f-9a6d-21e40bbad468 admin admin] PATH_INFO: `/v3/projects/566b79164e9f493aa2bfe927f418be61/users/78a8e5d100f74994a41561e44df08bbb/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.445932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fafa91-3397-422e-add7-c79aece656f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.446582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fafa91-3397-422e-add7-c79aece656f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.448238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fafa91-3397-422e-add7-c79aece656f3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.463205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 926/1864] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:06:17.463681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:17.466102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fafa91-3397-422e-add7-c79aece656f3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.470613 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23d8b0-d65d-478f-9a6d-21e40bbad468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=566b79164e9f493aa2bfe927f418be61, user_id=78a8e5d100f74994a41561e44df08bbb, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.473663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd23d8b0-d65d-478f-9a6d-21e40bbad468 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.494226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fafa91-3397-422e-add7-c79aece656f3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.496839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 939/1865] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:17 2022] PUT /identity/v3/projects/566b79164e9f493aa2bfe927f418be61/users/78a8e5d100f74994a41561e44df08bbb/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:17.508407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a4dd-a2b4-4cdc-9b79-936de5235e94 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.508818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a4dd-a2b4-4cdc-9b79-936de5235e94 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.509102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2a4dd-a2b4-4cdc-9b79-936de5235e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.545851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-b3f2a4dd-a2b4-4cdc-9b79-936de5235e94 None None] MFA Rules not processed for user `78a8e5d100f74994a41561e44df08bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:17.547741 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b3f2a4dd-a2b4-4cdc-9b79-936de5235e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:17.656492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe7540a-5bd7-4b36-8843-1a01a884e53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.657056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7540a-5bd7-4b36-8843-1a01a884e53d admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.657390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7540a-5bd7-4b36-8843-1a01a884e53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.658135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe7540a-5bd7-4b36-8843-1a01a884e53d admin admin] PATH_INFO: `/v3/projects/78e3fc884a924509b705a2aa7463a960/users/b23cbc76891f4155ac6b9e666be24778/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.666009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 940/1866] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:17.667757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2a4dd-a2b4-4cdc-9b79-936de5235e94 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.676597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7540a-5bd7-4b36-8843-1a01a884e53d admin admin] RBAC: Authorizing `identity:create_grant(project_id=78e3fc884a924509b705a2aa7463a960, user_id=b23cbc76891f4155ac6b9e666be24778, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.681003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe7540a-5bd7-4b36-8843-1a01a884e53d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.681208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2a4dd-a2b4-4cdc-9b79-936de5235e94 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.689319 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84ca2e-066f-471d-bd1f-6609fbb7986e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.690030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84ca2e-066f-471d-bd1f-6609fbb7986e admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.690385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84ca2e-066f-471d-bd1f-6609fbb7986e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.690742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca84ca2e-066f-471d-bd1f-6609fbb7986e admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.691637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84ca2e-066f-471d-bd1f-6609fbb7986e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.693614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca84ca2e-066f-471d-bd1f-6609fbb7986e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.713624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 927/1867] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:17 2022] PUT /identity/v3/projects/78e3fc884a924509b705a2aa7463a960/users/b23cbc76891f4155ac6b9e666be24778/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:17.715986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb8832-abc3-4b93-afd5-33bc10624f3e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.716804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb8832-abc3-4b93-afd5-33bc10624f3e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.717149 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1cb8832-abc3-4b93-afd5-33bc10624f3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.748629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 941/1868] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/projects => generated 365 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:17.750972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:17.751862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84ca2e-066f-471d-bd1f-6609fbb7986e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.759894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c1cb8832-abc3-4b93-afd5-33bc10624f3e None None] MFA Rules not processed for user `b23cbc76891f4155ac6b9e666be24778`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:17.763021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c1cb8832-abc3-4b93-afd5-33bc10624f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:17.871722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 928/1869] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:17.880112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca84ca2e-066f-471d-bd1f-6609fbb7986e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.884031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb8832-abc3-4b93-afd5-33bc10624f3e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.886278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c1cb8832-abc3-4b93-afd5-33bc10624f3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:17.887608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae093af8-f19f-4d56-9fef-1a26973c2957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.888313 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae093af8-f19f-4d56-9fef-1a26973c2957 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.888724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae093af8-f19f-4d56-9fef-1a26973c2957 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.890261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae093af8-f19f-4d56-9fef-1a26973c2957 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.891267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae093af8-f19f-4d56-9fef-1a26973c2957 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.894849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae093af8-f19f-4d56-9fef-1a26973c2957 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.928270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 942/1870] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:17 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:17.929555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae093af8-f19f-4d56-9fef-1a26973c2957 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.942428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae093af8-f19f-4d56-9fef-1a26973c2957 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.947372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68df3c-7399-476b-9a38-17bcce34dfef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.948003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68df3c-7399-476b-9a38-17bcce34dfef admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.948284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68df3c-7399-476b-9a38-17bcce34dfef admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.948558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d68df3c-7399-476b-9a38-17bcce34dfef admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.949212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68df3c-7399-476b-9a38-17bcce34dfef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:17.951024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d68df3c-7399-476b-9a38-17bcce34dfef admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:17.965463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 943/1871] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:17 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:17.970267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68df3c-7399-476b-9a38-17bcce34dfef admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:17.986476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d68df3c-7399-476b-9a38-17bcce34dfef admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.988340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1cb8832-abc3-4b93-afd5-33bc10624f3e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:17.992550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02517432-aa8e-488a-90ec-a4d19f90dbf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.992664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707063c-ca1c-4f7e-a8ba-166ae13aeb49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:17.993259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02517432-aa8e-488a-90ec-a4d19f90dbf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.993381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707063c-ca1c-4f7e-a8ba-166ae13aeb49 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:17.993543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707063c-ca1c-4f7e-a8ba-166ae13aeb49 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.993635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02517432-aa8e-488a-90ec-a4d19f90dbf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:17.993823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a707063c-ca1c-4f7e-a8ba-166ae13aeb49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:17.994036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02517432-aa8e-488a-90ec-a4d19f90dbf1 admin admin] PATH_INFO: `/v3/projects/04998709e11c413bb8d0a9f109adbc1b/users/3b6c9079b23f48c38587e4772dfcf6a7/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:18.005386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707063c-ca1c-4f7e-a8ba-166ae13aeb49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:18.007000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a707063c-ca1c-4f7e-a8ba-166ae13aeb49 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:18.014450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02517432-aa8e-488a-90ec-a4d19f90dbf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04998709e11c413bb8d0a9f109adbc1b, user_id=3b6c9079b23f48c38587e4772dfcf6a7, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:18.017394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02517432-aa8e-488a-90ec-a4d19f90dbf1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:18.030938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 929/1872] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:18.044453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707063c-ca1c-4f7e-a8ba-166ae13aeb49 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:18.048389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 944/1873] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:17 2022] PUT /identity/v3/projects/04998709e11c413bb8d0a9f109adbc1b/users/3b6c9079b23f48c38587e4772dfcf6a7/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:18.052751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02517432-aa8e-488a-90ec-a4d19f90dbf1 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:18.072746 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:18.078016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a707063c-ca1c-4f7e-a8ba-166ae13aeb49 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:18.154611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02517432-aa8e-488a-90ec-a4d19f90dbf1 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:18.162465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c0ff5-b64c-4a19-b071-248a9232e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:18.163798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c0ff5-b64c-4a19-b071-248a9232e6ee admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:18.164166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c0ff5-b64c-4a19-b071-248a9232e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:18.164513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8c0ff5-b64c-4a19-b071-248a9232e6ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:18.165272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c0ff5-b64c-4a19-b071-248a9232e6ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:18.167748 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8c0ff5-b64c-4a19-b071-248a9232e6ee admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:18.181237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 945/1874] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:18.185160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c0ff5-b64c-4a19-b071-248a9232e6ee admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:18.202264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8c0ff5-b64c-4a19-b071-248a9232e6ee admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:18.207379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac67c6-0b93-426b-8ff7-9edff03b980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:18.208477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac67c6-0b93-426b-8ff7-9edff03b980f admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:18.208920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac67c6-0b93-426b-8ff7-9edff03b980f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:18.209342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac67c6-0b93-426b-8ff7-9edff03b980f admin admin] PATH_INFO: `/v3/projects/04998709e11c413bb8d0a9f109adbc1b/users/3b6c9079b23f48c38587e4772dfcf6a7/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:18.211878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac67c6-0b93-426b-8ff7-9edff03b980f admin admin] RBAC: Authorizing `identity:create_grant(project_id=04998709e11c413bb8d0a9f109adbc1b, user_id=3b6c9079b23f48c38587e4772dfcf6a7, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:18.215570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac67c6-0b93-426b-8ff7-9edff03b980f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:18.231867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 946/1875] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:18 2022] PUT /identity/v3/projects/04998709e11c413bb8d0a9f109adbc1b/users/3b6c9079b23f48c38587e4772dfcf6a7/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:18.240737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:18.240737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:18.240737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:18.240737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] PATH_INFO: `/v3/users/b23cbc76891f4155ac6b9e666be24778` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:18.241011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b23cbc76891f4155ac6b9e666be24778)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:18.241011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:18.243986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75751-11c4-4267-b234-d7eed8ad68d8 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:18.244806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75751-11c4-4267-b234-d7eed8ad68d8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:18.245480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d75751-11c4-4267-b234-d7eed8ad68d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:18.279110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-80d75751-11c4-4267-b234-d7eed8ad68d8 None None] MFA Rules not processed for user `3b6c9079b23f48c38587e4772dfcf6a7`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:18.280535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-80d75751-11c4-4267-b234-d7eed8ad68d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:18.305214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b23cbc76891f4155ac6b9e666be24778'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:18.306001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b23cbc76891f4155ac6b9e666be24778'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:18.306751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b23cbc76891f4155ac6b9e666be24778'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:18.308335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:18.331876 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b23cbc76891f4155ac6b9e666be24778'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:18.344592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-e5b540ac-ff54-4a2e-9226-2c2f9284b386 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b23cbc76891f4155ac6b9e666be24778'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:18.368007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 930/1876] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:18 2022] DELETE /identity/v3/users/b23cbc76891f4155ac6b9e666be24778 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:18.373925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe448df-6a59-4657-af50-87deb5e90f92 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:18.374304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe448df-6a59-4657-af50-87deb5e90f92 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:18.374481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe448df-6a59-4657-af50-87deb5e90f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:18.402015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 947/1877] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:18 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:18.415332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d75751-11c4-4267-b234-d7eed8ad68d8 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:18.419013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-80d75751-11c4-4267-b234-d7eed8ad68d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:18.422637 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4fe448df-6a59-4657-af50-87deb5e90f92 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:18.423931 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4fe448df-6a59-4657-af50-87deb5e90f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:18.517300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 931/1878] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:18.527997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe448df-6a59-4657-af50-87deb5e90f92 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:18.530388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4fe448df-6a59-4657-af50-87deb5e90f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:18.575316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d75751-11c4-4267-b234-d7eed8ad68d8 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:18.650047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe448df-6a59-4657-af50-87deb5e90f92 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:18.655865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b889ebd-cd64-4a52-a780-24a8fcda955f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:18.655865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b889ebd-cd64-4a52-a780-24a8fcda955f service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:18.660414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:18.666014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b889ebd-cd64-4a52-a780-24a8fcda955f service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:18.669994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b889ebd-cd64-4a52-a780-24a8fcda955f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:18.689502 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b889ebd-cd64-4a52-a780-24a8fcda955f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:18.691096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b889ebd-cd64-4a52-a780-24a8fcda955f service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:18.692423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0c0f7-e4e0-4f59-aed2-2c0a1001e94b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:18.693902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c0f7-e4e0-4f59-aed2-2c0a1001e94b service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:18.694380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c0f7-e4e0-4f59-aed2-2c0a1001e94b service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:18.694860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b0c0f7-e4e0-4f59-aed2-2c0a1001e94b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:18.705786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 932/1879] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:18.788353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0c0f7-e4e0-4f59-aed2-2c0a1001e94b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:18.790071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b0c0f7-e4e0-4f59-aed2-2c0a1001e94b service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:18.801488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 948/1880] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:18 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:18.940630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b889ebd-cd64-4a52-a780-24a8fcda955f service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:18.955532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b889ebd-cd64-4a52-a780-24a8fcda955f service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:18.971636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70d1c04-2c46-4df0-9e8d-d16666ff72d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:18.972840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d1c04-2c46-4df0-9e8d-d16666ff72d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:18.973130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d1c04-2c46-4df0-9e8d-d16666ff72d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:18.973425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70d1c04-2c46-4df0-9e8d-d16666ff72d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:18.975438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d70d1c04-2c46-4df0-9e8d-d16666ff72d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:19.111201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d1c04-2c46-4df0-9e8d-d16666ff72d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:19.113611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70d1c04-2c46-4df0-9e8d-d16666ff72d7 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:19.136439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 933/1881] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:19.693574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0c0f7-e4e0-4f59-aed2-2c0a1001e94b service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:19.695180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-86b0c0f7-e4e0-4f59-aed2-2c0a1001e94b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:19.710811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b0c0f7-e4e0-4f59-aed2-2c0a1001e94b service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:19.715733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:19.716416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:19.716695 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:19.716987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] PATH_INFO: `/v3/projects/78e3fc884a924509b705a2aa7463a960` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:19.718135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=78e3fc884a924509b705a2aa7463a960)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:19.720078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:19.770122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78e3fc884a924509b705a2aa7463a960', 'request_id': 'req-c8745425-e8f5-416e-b128-e06367249a01'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:19.775897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78e3fc884a924509b705a2aa7463a960', 'request_id': 'req-c8745425-e8f5-416e-b128-e06367249a01'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:19.785714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78e3fc884a924509b705a2aa7463a960', 'request_id': 'req-c8745425-e8f5-416e-b128-e06367249a01'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:19.798115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] The token cache is being invalidate because project 78e3fc884a924509b705a2aa7463a960 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:19.798436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:19.799111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8745425-e8f5-416e-b128-e06367249a01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:19.800708 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 949/1882] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:19 2022] DELETE /identity/v3/projects/78e3fc884a924509b705a2aa7463a960 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:19.805628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf2d2-25f6-406d-807e-e0ba96aee165 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:19.806121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf2d2-25f6-406d-807e-e0ba96aee165 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:19.806219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebaf2d2-25f6-406d-807e-e0ba96aee165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:19.819917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:19.828322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-aebaf2d2-25f6-406d-807e-e0ba96aee165 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:19.830023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aebaf2d2-25f6-406d-807e-e0ba96aee165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:19.894581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 934/1883] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:19.902538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca505-b61f-4ead-9242-160a9e79fe18 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:19.902827 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca505-b61f-4ead-9242-160a9e79fe18 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:19.903124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfca505-b61f-4ead-9242-160a9e79fe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:19.924364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ccfca505-b61f-4ead-9242-160a9e79fe18 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:19.925593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ccfca505-b61f-4ead-9242-160a9e79fe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:19.935611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 950/1884] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:19.940244 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaf2d2-25f6-406d-807e-e0ba96aee165 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:19.950696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebaf2d2-25f6-406d-807e-e0ba96aee165 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:19.956898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2590a-d227-4094-b57a-cf61e7f7560f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:19.957512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2590a-d227-4094-b57a-cf61e7f7560f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:19.957782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2590a-d227-4094-b57a-cf61e7f7560f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:19.958051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2590a-d227-4094-b57a-cf61e7f7560f admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:19.958699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2590a-d227-4094-b57a-cf61e7f7560f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:19.959038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2590a-d227-4094-b57a-cf61e7f7560f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:19.960652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2590a-d227-4094-b57a-cf61e7f7560f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:19.973253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 935/1885] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:06:19.979684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca505-b61f-4ead-9242-160a9e79fe18 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:19.989708 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfca505-b61f-4ead-9242-160a9e79fe18 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:19.995394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccba018-961d-4861-8bfd-d7b82993d619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:19.995999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba018-961d-4861-8bfd-d7b82993d619 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:19.996271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba018-961d-4861-8bfd-d7b82993d619 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:19.996539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccba018-961d-4861-8bfd-d7b82993d619 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:19.997141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccba018-961d-4861-8bfd-d7b82993d619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:19.999302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccba018-961d-4861-8bfd-d7b82993d619 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.031517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 951/1886] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:19 2022] POST /identity/v3/projects => generated 375 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:20.035870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2590a-d227-4094-b57a-cf61e7f7560f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.046603 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2590a-d227-4094-b57a-cf61e7f7560f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.103998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc744fc5-355a-452b-bdcb-0b537d9f6db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.104644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc744fc5-355a-452b-bdcb-0b537d9f6db7 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.104931 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc744fc5-355a-452b-bdcb-0b537d9f6db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.105191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc744fc5-355a-452b-bdcb-0b537d9f6db7 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.105815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc744fc5-355a-452b-bdcb-0b537d9f6db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.107815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc744fc5-355a-452b-bdcb-0b537d9f6db7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.134236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 936/1887] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:20 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:20.135329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccba018-961d-4861-8bfd-d7b82993d619 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.146963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccba018-961d-4861-8bfd-d7b82993d619 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.151701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721294e2-112f-4ae2-bbd2-e245c23f30a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.152308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721294e2-112f-4ae2-bbd2-e245c23f30a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.152585 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721294e2-112f-4ae2-bbd2-e245c23f30a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.152851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721294e2-112f-4ae2-bbd2-e245c23f30a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.153519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721294e2-112f-4ae2-bbd2-e245c23f30a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.155229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721294e2-112f-4ae2-bbd2-e245c23f30a7 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.165182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 952/1888] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:20.169145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc744fc5-355a-452b-bdcb-0b537d9f6db7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.180636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc744fc5-355a-452b-bdcb-0b537d9f6db7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.185460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b9626-e1f6-4757-937a-4888627e91c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.186057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b9626-e1f6-4757-937a-4888627e91c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.186337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b9626-e1f6-4757-937a-4888627e91c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.186586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b9626-e1f6-4757-937a-4888627e91c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.187266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b9626-e1f6-4757-937a-4888627e91c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.188841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935b9626-e1f6-4757-937a-4888627e91c2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.199987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 937/1889] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:20.204848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721294e2-112f-4ae2-bbd2-e245c23f30a7 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.216248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721294e2-112f-4ae2-bbd2-e245c23f30a7 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.220289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d195ab-01f8-4aac-959b-dad830cfdc96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.220947 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d195ab-01f8-4aac-959b-dad830cfdc96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.221225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d195ab-01f8-4aac-959b-dad830cfdc96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.221499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d195ab-01f8-4aac-959b-dad830cfdc96 admin admin] PATH_INFO: `/v3/projects/274386a5a7a54d4ea447f3fde513b12d/users/434e2fa3932f460ca9d7ec7e064c9738/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.236784 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d195ab-01f8-4aac-959b-dad830cfdc96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=274386a5a7a54d4ea447f3fde513b12d, user_id=434e2fa3932f460ca9d7ec7e064c9738, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.239570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d195ab-01f8-4aac-959b-dad830cfdc96 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.254349 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 953/1890] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:20 2022] PUT /identity/v3/projects/274386a5a7a54d4ea447f3fde513b12d/users/434e2fa3932f460ca9d7ec7e064c9738/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:20.265213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede316-b911-4c50-80ee-08dbd3a618b4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.265518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede316-b911-4c50-80ee-08dbd3a618b4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.265791 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ede316-b911-4c50-80ee-08dbd3a618b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.296860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-45ede316-b911-4c50-80ee-08dbd3a618b4 None None] MFA Rules not processed for user `434e2fa3932f460ca9d7ec7e064c9738`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:20.298080 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-45ede316-b911-4c50-80ee-08dbd3a618b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:20.369844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 938/1891] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:20.376021 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d195ab-01f8-4aac-959b-dad830cfdc96 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.382595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:20.443850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d195ab-01f8-4aac-959b-dad830cfdc96 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.449036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8bfa1-dbaa-47df-a4ac-e23eaebe2745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.449684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8bfa1-dbaa-47df-a4ac-e23eaebe2745 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.449992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8bfa1-dbaa-47df-a4ac-e23eaebe2745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.450260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce8bfa1-dbaa-47df-a4ac-e23eaebe2745 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.451376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8bfa1-dbaa-47df-a4ac-e23eaebe2745 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.453331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce8bfa1-dbaa-47df-a4ac-e23eaebe2745 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.481816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 954/1892] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:20 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:20.486089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ede316-b911-4c50-80ee-08dbd3a618b4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.492194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:20.500516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ede316-b911-4c50-80ee-08dbd3a618b4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.580035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6d0f0-e97a-4875-bd33-aff6ae9cc521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.580900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6d0f0-e97a-4875-bd33-aff6ae9cc521 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.581326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6d0f0-e97a-4875-bd33-aff6ae9cc521 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.581868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f6d0f0-e97a-4875-bd33-aff6ae9cc521 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.582983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6d0f0-e97a-4875-bd33-aff6ae9cc521 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.585088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f6d0f0-e97a-4875-bd33-aff6ae9cc521 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.611032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 939/1893] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:20 2022] POST /identity/v3/users => generated 288 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:20.615226 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8bfa1-dbaa-47df-a4ac-e23eaebe2745 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.626365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce8bfa1-dbaa-47df-a4ac-e23eaebe2745 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.636876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0440c-7055-4ba1-94d3-6b858ea6284c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.637533 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0440c-7055-4ba1-94d3-6b858ea6284c admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.637813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0440c-7055-4ba1-94d3-6b858ea6284c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.638079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0440c-7055-4ba1-94d3-6b858ea6284c admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.638872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0440c-7055-4ba1-94d3-6b858ea6284c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.640699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af0440c-7055-4ba1-94d3-6b858ea6284c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.655063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 955/1894] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:06:20.658989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6d0f0-e97a-4875-bd33-aff6ae9cc521 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.666803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f6d0f0-e97a-4875-bd33-aff6ae9cc521 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.671622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f4c6fd-caff-42fc-ade7-505b49b622b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.672239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4c6fd-caff-42fc-ade7-505b49b622b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.672519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4c6fd-caff-42fc-ade7-505b49b622b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.673076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f4c6fd-caff-42fc-ade7-505b49b622b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.673715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4c6fd-caff-42fc-ade7-505b49b622b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.675342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f4c6fd-caff-42fc-ade7-505b49b622b3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.685475 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 940/1895] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:06:20.689605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0440c-7055-4ba1-94d3-6b858ea6284c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.699897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0440c-7055-4ba1-94d3-6b858ea6284c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.705081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d3809-9b25-4324-a2ad-881815fa65eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.705745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d3809-9b25-4324-a2ad-881815fa65eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.706045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d3809-9b25-4324-a2ad-881815fa65eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.706271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d3809-9b25-4324-a2ad-881815fa65eb admin admin] PATH_INFO: `/v3/projects/952c4b1c75574694bcef4fff37d27f1f/users/0f126a2ed9e949469d24f26577faf699/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.722167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d3809-9b25-4324-a2ad-881815fa65eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=952c4b1c75574694bcef4fff37d27f1f, user_id=0f126a2ed9e949469d24f26577faf699, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.724910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d3809-9b25-4324-a2ad-881815fa65eb admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.738287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 956/1896] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:20 2022] PUT /identity/v3/projects/952c4b1c75574694bcef4fff37d27f1f/users/0f126a2ed9e949469d24f26577faf699/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:20.749595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7818-fd6e-4a27-86af-8935785857e4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.749883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7818-fd6e-4a27-86af-8935785857e4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.750151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc7818-fd6e-4a27-86af-8935785857e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.779561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0dbc7818-fd6e-4a27-86af-8935785857e4 None None] MFA Rules not processed for user `0f126a2ed9e949469d24f26577faf699`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:20.781596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0dbc7818-fd6e-4a27-86af-8935785857e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:20.869003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 941/1897] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:20.873792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d3809-9b25-4324-a2ad-881815fa65eb admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:20.944351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d3809-9b25-4324-a2ad-881815fa65eb admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:20.949394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5e4e7-7bfa-4b56-a6f2-b258121bb966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:20.949999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5e4e7-7bfa-4b56-a6f2-b258121bb966 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:20.950276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5e4e7-7bfa-4b56-a6f2-b258121bb966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:20.950548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec5e4e7-7bfa-4b56-a6f2-b258121bb966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:20.951237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5e4e7-7bfa-4b56-a6f2-b258121bb966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:20.953172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec5e4e7-7bfa-4b56-a6f2-b258121bb966 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:20.985485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 957/1898] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:20 2022] POST /identity/v3/projects => generated 375 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:20.991015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc7818-fd6e-4a27-86af-8935785857e4 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:21.003079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc7818-fd6e-4a27-86af-8935785857e4 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:21.065651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e532a2-7a2c-4468-bcad-6f5ddb505d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:21.066256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e532a2-7a2c-4468-bcad-6f5ddb505d8e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.066533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e532a2-7a2c-4468-bcad-6f5ddb505d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.066814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e532a2-7a2c-4468-bcad-6f5ddb505d8e admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.067467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e532a2-7a2c-4468-bcad-6f5ddb505d8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:21.069402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e532a2-7a2c-4468-bcad-6f5ddb505d8e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:21.092031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:21.098400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 942/1899] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:20 2022] POST /identity/v3/users => generated 294 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:21.103189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5e4e7-7bfa-4b56-a6f2-b258121bb966 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:21.114421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec5e4e7-7bfa-4b56-a6f2-b258121bb966 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:21.121044 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb3df-2dc9-47c8-b50d-0eccd00f1c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:21.121680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb3df-2dc9-47c8-b50d-0eccd00f1c52 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.121950 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb3df-2dc9-47c8-b50d-0eccd00f1c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.122211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6babb3df-2dc9-47c8-b50d-0eccd00f1c52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.122955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babb3df-2dc9-47c8-b50d-0eccd00f1c52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:21.124568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6babb3df-2dc9-47c8-b50d-0eccd00f1c52 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:21.136237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 958/1900] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:21.142200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e532a2-7a2c-4468-bcad-6f5ddb505d8e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:21.153614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e532a2-7a2c-4468-bcad-6f5ddb505d8e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:21.161026 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e7323-e5c0-4bbb-a240-bcb5c6629e01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:21.161966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7323-e5c0-4bbb-a240-bcb5c6629e01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.162151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7323-e5c0-4bbb-a240-bcb5c6629e01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.162400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05e7323-e5c0-4bbb-a240-bcb5c6629e01 admin admin] PATH_INFO: `/v3/projects/f31a260853574c0eb1fa92a14608f31e/users/a85fb16ae3b243759116da939ea0b4c4/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.178966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e7323-e5c0-4bbb-a240-bcb5c6629e01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31a260853574c0eb1fa92a14608f31e, user_id=a85fb16ae3b243759116da939ea0b4c4, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:21.181706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05e7323-e5c0-4bbb-a240-bcb5c6629e01 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:21.196216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 943/1901] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:21 2022] PUT /identity/v3/projects/f31a260853574c0eb1fa92a14608f31e/users/a85fb16ae3b243759116da939ea0b4c4/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:21.200381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb3df-2dc9-47c8-b50d-0eccd00f1c52 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:21.210635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6babb3df-2dc9-47c8-b50d-0eccd00f1c52 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:21.245983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:21.283669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20632a5f-7316-4145-819e-7bfa1c1e45de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:21.284298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20632a5f-7316-4145-819e-7bfa1c1e45de admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.284577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20632a5f-7316-4145-819e-7bfa1c1e45de admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.284848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20632a5f-7316-4145-819e-7bfa1c1e45de admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.285495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20632a5f-7316-4145-819e-7bfa1c1e45de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:21.287152 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20632a5f-7316-4145-819e-7bfa1c1e45de admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:21.297795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 959/1902] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:21 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:21.301938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e7323-e5c0-4bbb-a240-bcb5c6629e01 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:21.312778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05e7323-e5c0-4bbb-a240-bcb5c6629e01 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:21.318033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809303a4-a4c2-47e2-9940-cc6f6c657517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:21.318696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809303a4-a4c2-47e2-9940-cc6f6c657517 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.319492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809303a4-a4c2-47e2-9940-cc6f6c657517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.319492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809303a4-a4c2-47e2-9940-cc6f6c657517 admin admin] PATH_INFO: `/v3/projects/f31a260853574c0eb1fa92a14608f31e/users/a85fb16ae3b243759116da939ea0b4c4/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.321677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809303a4-a4c2-47e2-9940-cc6f6c657517 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f31a260853574c0eb1fa92a14608f31e, user_id=a85fb16ae3b243759116da939ea0b4c4, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:21.324617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809303a4-a4c2-47e2-9940-cc6f6c657517 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:21.337162 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 944/1903] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:21 2022] PUT /identity/v3/projects/f31a260853574c0eb1fa92a14608f31e/users/a85fb16ae3b243759116da939ea0b4c4/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:21.347951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1e66f-2218-4109-beb7-f2f8ff31294d None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.348242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1e66f-2218-4109-beb7-f2f8ff31294d None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.348520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa1e66f-2218-4109-beb7-f2f8ff31294d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.376608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-faa1e66f-2218-4109-beb7-f2f8ff31294d None None] MFA Rules not processed for user `a85fb16ae3b243759116da939ea0b4c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:21.377818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-faa1e66f-2218-4109-beb7-f2f8ff31294d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:21.460394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 960/1904] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:21.472512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809303a4-a4c2-47e2-9940-cc6f6c657517 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:21.474625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-809303a4-a4c2-47e2-9940-cc6f6c657517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:21.546895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809303a4-a4c2-47e2-9940-cc6f6c657517 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:21.550961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f7f0a-24a8-4162-a3aa-a12aa5eaa4f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:21.551568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f7f0a-24a8-4162-a3aa-a12aa5eaa4f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:21.551846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f7f0a-24a8-4162-a3aa-a12aa5eaa4f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:21.552114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696f7f0a-24a8-4162-a3aa-a12aa5eaa4f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:21.611866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f7f0a-24a8-4162-a3aa-a12aa5eaa4f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:21.613309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696f7f0a-24a8-4162-a3aa-a12aa5eaa4f1 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:21.622364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 945/1905] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:21 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:23.249277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1e66f-2218-4109-beb7-f2f8ff31294d None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:23.259619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa1e66f-2218-4109-beb7-f2f8ff31294d None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:23.264325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437953be-ced1-4719-8b5a-a378022a9803 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:23.264935 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437953be-ced1-4719-8b5a-a378022a9803 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:23.265214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437953be-ced1-4719-8b5a-a378022a9803 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:23.265483 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437953be-ced1-4719-8b5a-a378022a9803 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:23.325054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437953be-ced1-4719-8b5a-a378022a9803 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:23.326520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437953be-ced1-4719-8b5a-a378022a9803 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:23.336239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 961/1906] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:23.514438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f7f0a-24a8-4162-a3aa-a12aa5eaa4f1 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:23.516024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-696f7f0a-24a8-4162-a3aa-a12aa5eaa4f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:23.598646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696f7f0a-24a8-4162-a3aa-a12aa5eaa4f1 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:23.603992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:23.604762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:23.605096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:23.605394 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] PATH_INFO: `/v3/users/06a2b2e188354fb6938942df20c43148` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:23.607515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] RBAC: Authorizing `identity:delete_user(user_id=06a2b2e188354fb6938942df20c43148)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:23.609583 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:23.634322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:23.665445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06a2b2e188354fb6938942df20c43148'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:23.666158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06a2b2e188354fb6938942df20c43148'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:23.666778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06a2b2e188354fb6938942df20c43148'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:23.679534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06a2b2e188354fb6938942df20c43148'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:23.688609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06a2b2e188354fb6938942df20c43148'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:23.702383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 946/1907] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:23 2022] DELETE /identity/v3/users/06a2b2e188354fb6938942df20c43148 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:23.706869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43f97c-015e-472f-8c25-6f576fc4066c None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:23.707157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43f97c-015e-472f-8c25-6f576fc4066c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:23.707455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d43f97c-015e-472f-8c25-6f576fc4066c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:23.726995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-4d43f97c-015e-472f-8c25-6f576fc4066c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:23.728195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4d43f97c-015e-472f-8c25-6f576fc4066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:23.775917 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:23.791736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 962/1908] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:23.801839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:23.803403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:23.863871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4ac0b2-2f28-4bcb-afb2-111428027596 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:23.868878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86451a46-90a0-43ab-a308-12ce2d4d8142 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:23.869491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86451a46-90a0-43ab-a308-12ce2d4d8142 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:23.869775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86451a46-90a0-43ab-a308-12ce2d4d8142 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:23.870075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86451a46-90a0-43ab-a308-12ce2d4d8142 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:23.880947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86451a46-90a0-43ab-a308-12ce2d4d8142 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:23.882362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86451a46-90a0-43ab-a308-12ce2d4d8142 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:23.892721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 947/1909] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:24.267172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43f97c-015e-472f-8c25-6f576fc4066c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:24.269062 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4d43f97c-015e-472f-8c25-6f576fc4066c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:24.281691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d43f97c-015e-472f-8c25-6f576fc4066c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:24.286640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:24.287404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:24.287568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:24.287996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] PATH_INFO: `/v3/projects/f0697dfcf1034bbdbffd793a6ff392e9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:24.289134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0697dfcf1034bbdbffd793a6ff392e9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:24.291060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:24.345989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0697dfcf1034bbdbffd793a6ff392e9', 'request_id': 'req-53d53e12-0cd5-47cd-8f2e-d34e7069598f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:24.351920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0697dfcf1034bbdbffd793a6ff392e9', 'request_id': 'req-53d53e12-0cd5-47cd-8f2e-d34e7069598f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:24.361206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0697dfcf1034bbdbffd793a6ff392e9', 'request_id': 'req-53d53e12-0cd5-47cd-8f2e-d34e7069598f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:24.373133 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] The token cache is being invalidate because project f0697dfcf1034bbdbffd793a6ff392e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:24.373397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:24.374278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:24.375867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 963/1910] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:24 2022] DELETE /identity/v3/projects/f0697dfcf1034bbdbffd793a6ff392e9 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:24.379929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86451a46-90a0-43ab-a308-12ce2d4d8142 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:24.390238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86451a46-90a0-43ab-a308-12ce2d4d8142 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:24.450306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:24.451306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:24.451731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:24.452090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] PATH_INFO: `/v3/users/cb0f105016da40a3a071bad249b7f91f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:24.453752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0f105016da40a3a071bad249b7f91f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:24.455725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:24.498255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:24.503847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0f105016da40a3a071bad249b7f91f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:24.504729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0f105016da40a3a071bad249b7f91f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:24.505647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0f105016da40a3a071bad249b7f91f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:24.518066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0f105016da40a3a071bad249b7f91f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:24.527073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b97f01ea-9d73-47cb-91fa-b56160428b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0f105016da40a3a071bad249b7f91f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:24.539582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 948/1911] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:24 2022] DELETE /identity/v3/users/cb0f105016da40a3a071bad249b7f91f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:24.924695 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:24.926238 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:24.940470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d53e12-0cd5-47cd-8f2e-d34e7069598f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.000871 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.001523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.001802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.002071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] PATH_INFO: `/v3/projects/9c0806e033804f85900bc5cf5b1d41b9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.003343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c0806e033804f85900bc5cf5b1d41b9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:25.005429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:25.053733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c0806e033804f85900bc5cf5b1d41b9', 'request_id': 'req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:25.059483 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c0806e033804f85900bc5cf5b1d41b9', 'request_id': 'req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:25.073214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c0806e033804f85900bc5cf5b1d41b9', 'request_id': 'req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:25.085579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] The token cache is being invalidate because project 9c0806e033804f85900bc5cf5b1d41b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:25.085878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:25.086710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3f529c8b-1f2d-465e-99cc-e1a7e1fac3ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:25.088347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 964/1912] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:24 2022] DELETE /identity/v3/projects/9c0806e033804f85900bc5cf5b1d41b9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:25.093620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8decb-3251-4678-b5ae-50379a0d4dbd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.093907 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8decb-3251-4678-b5ae-50379a0d4dbd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.094177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8decb-3251-4678-b5ae-50379a0d4dbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.117132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fde8decb-3251-4678-b5ae-50379a0d4dbd None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:25.118347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fde8decb-3251-4678-b5ae-50379a0d4dbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.193144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 949/1913] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:25.201986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ec4d3-3b14-4328-8917-05b3d690412a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.202270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ec4d3-3b14-4328-8917-05b3d690412a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.202545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9ec4d3-3b14-4328-8917-05b3d690412a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.211086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:25.226436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-3c9ec4d3-3b14-4328-8917-05b3d690412a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:25.229069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3c9ec4d3-3b14-4328-8917-05b3d690412a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.238735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 965/1914] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:25.243280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8decb-3251-4678-b5ae-50379a0d4dbd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.259493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8decb-3251-4678-b5ae-50379a0d4dbd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.266575 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5962e-3791-46e9-8e61-b665d9171fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.267030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5962e-3791-46e9-8e61-b665d9171fc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.267302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5962e-3791-46e9-8e61-b665d9171fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.267583 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd5962e-3791-46e9-8e61-b665d9171fc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.268264 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5962e-3791-46e9-8e61-b665d9171fc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:25.269050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5962e-3791-46e9-8e61-b665d9171fc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:25.270841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd5962e-3791-46e9-8e61-b665d9171fc1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:25.285473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 950/1915] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:06:25.289996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ec4d3-3b14-4328-8917-05b3d690412a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.301704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9ec4d3-3b14-4328-8917-05b3d690412a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.306758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d12d47-e9bd-4270-91b8-911aa681e703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.307469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12d47-e9bd-4270-91b8-911aa681e703 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.307838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12d47-e9bd-4270-91b8-911aa681e703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.308199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d12d47-e9bd-4270-91b8-911aa681e703 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.308894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d12d47-e9bd-4270-91b8-911aa681e703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:25.310865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d12d47-e9bd-4270-91b8-911aa681e703 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:25.345177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 966/1916] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:25 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:25.349573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5962e-3791-46e9-8e61-b665d9171fc1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.361659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd5962e-3791-46e9-8e61-b665d9171fc1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.448813 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57920b5-09d2-4d85-ae38-603830ffc02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.449462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57920b5-09d2-4d85-ae38-603830ffc02f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.449749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57920b5-09d2-4d85-ae38-603830ffc02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.450024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57920b5-09d2-4d85-ae38-603830ffc02f admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.450717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57920b5-09d2-4d85-ae38-603830ffc02f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:25.453469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57920b5-09d2-4d85-ae38-603830ffc02f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:25.480596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 951/1917] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:25 2022] POST /identity/v3/users => generated 287 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:25.485810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d12d47-e9bd-4270-91b8-911aa681e703 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.502552 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d12d47-e9bd-4270-91b8-911aa681e703 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.507969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702084b-822a-462c-8740-260ba0edbd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.508934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702084b-822a-462c-8740-260ba0edbd57 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.508934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702084b-822a-462c-8740-260ba0edbd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.509197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4702084b-822a-462c-8740-260ba0edbd57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.510114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702084b-822a-462c-8740-260ba0edbd57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:25.512079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4702084b-822a-462c-8740-260ba0edbd57 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:25.529000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 967/1918] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:06:25.531185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57920b5-09d2-4d85-ae38-603830ffc02f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.549028 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57920b5-09d2-4d85-ae38-603830ffc02f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.559019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397b8b81-5242-40d7-b85f-4da3f4680c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.559933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8b81-5242-40d7-b85f-4da3f4680c47 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.560533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8b81-5242-40d7-b85f-4da3f4680c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.561005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397b8b81-5242-40d7-b85f-4da3f4680c47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.562205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b8b81-5242-40d7-b85f-4da3f4680c47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:25.565291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397b8b81-5242-40d7-b85f-4da3f4680c47 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:25.586811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 952/1919] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:25.592756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702084b-822a-462c-8740-260ba0edbd57 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.606182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4702084b-822a-462c-8740-260ba0edbd57 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.612468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a7b95-b678-4f17-83ee-9837a6ba093b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.614348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a7b95-b678-4f17-83ee-9837a6ba093b admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.614649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a7b95-b678-4f17-83ee-9837a6ba093b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.614964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8a7b95-b678-4f17-83ee-9837a6ba093b admin admin] PATH_INFO: `/v3/projects/128da58fcffa44c89ab3f04be90aa76a/users/f788306b055f42bdbdc82392f2c985d8/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.640729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a7b95-b678-4f17-83ee-9837a6ba093b admin admin] RBAC: Authorizing `identity:create_grant(project_id=128da58fcffa44c89ab3f04be90aa76a, user_id=f788306b055f42bdbdc82392f2c985d8, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:25.644018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8a7b95-b678-4f17-83ee-9837a6ba093b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:25.691005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 968/1920] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:25 2022] PUT /identity/v3/projects/128da58fcffa44c89ab3f04be90aa76a/users/f788306b055f42bdbdc82392f2c985d8/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:25.696862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fb83a-f498-4631-892a-86f682a29a60 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.697241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fb83a-f498-4631-892a-86f682a29a60 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.697517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373fb83a-f498-4631-892a-86f682a29a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.735515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-373fb83a-f498-4631-892a-86f682a29a60 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:25.737105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-373fb83a-f498-4631-892a-86f682a29a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.768619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:25.774022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a7b95-b678-4f17-83ee-9837a6ba093b admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.778989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-bd8a7b95-b678-4f17-83ee-9837a6ba093b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.847542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8a7b95-b678-4f17-83ee-9837a6ba093b admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.851758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff127a-deba-4d11-b239-b0575774f950 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.852009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff127a-deba-4d11-b239-b0575774f950 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.852229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff127a-deba-4d11-b239-b0575774f950 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.852507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff127a-deba-4d11-b239-b0575774f950 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.854304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c5ff127a-deba-4d11-b239-b0575774f950 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.874461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 953/1921] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:25.886940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fb83a-f498-4631-892a-86f682a29a60 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:25.888667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-373fb83a-f498-4631-892a-86f682a29a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:25.977957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373fb83a-f498-4631-892a-86f682a29a60 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:25.984655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad271a-b4a3-445a-bf52-ba7aabd91bca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:25.985554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad271a-b4a3-445a-bf52-ba7aabd91bca service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:25.985894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad271a-b4a3-445a-bf52-ba7aabd91bca service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:25.986235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad271a-b4a3-445a-bf52-ba7aabd91bca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:25.999266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad271a-b4a3-445a-bf52-ba7aabd91bca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:26.000873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad271a-b4a3-445a-bf52-ba7aabd91bca service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:26.014969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff127a-deba-4d11-b239-b0575774f950 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:26.017043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 954/1922] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:26.017140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff127a-deba-4d11-b239-b0575774f950 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:26.051552 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 969/1923] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 278 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:27.403715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157217f-4562-48b1-a5a1-b0bd0d44841c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.405272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157217f-4562-48b1-a5a1-b0bd0d44841c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.406839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157217f-4562-48b1-a5a1-b0bd0d44841c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.439069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7157217f-4562-48b1-a5a1-b0bd0d44841c None None] MFA Rules not processed for user `f788306b055f42bdbdc82392f2c985d8`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:27.440603 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7157217f-4562-48b1-a5a1-b0bd0d44841c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:27.547068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 955/1924] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:27.552077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff127a-deba-4d11-b239-b0575774f950 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:27.564712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff127a-deba-4d11-b239-b0575774f950 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:27.579170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef0d8c-dad5-41cd-8d57-0b99a319e4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:27.579809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef0d8c-dad5-41cd-8d57-0b99a319e4a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.580330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef0d8c-dad5-41cd-8d57-0b99a319e4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.580740 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeef0d8c-dad5-41cd-8d57-0b99a319e4a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.581517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef0d8c-dad5-41cd-8d57-0b99a319e4a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:27.584584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeef0d8c-dad5-41cd-8d57-0b99a319e4a4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:27.641352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157217f-4562-48b1-a5a1-b0bd0d44841c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:27.642172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 970/1925] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:27 2022] POST /identity/v3/projects => generated 373 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:27.653607 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157217f-4562-48b1-a5a1-b0bd0d44841c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:27.736730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:27.746041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b463e-15c4-4941-abb7-1131a4e4e959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:27.746855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b463e-15c4-4941-abb7-1131a4e4e959 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.747139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b463e-15c4-4941-abb7-1131a4e4e959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.747820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b463e-15c4-4941-abb7-1131a4e4e959 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.748082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b463e-15c4-4941-abb7-1131a4e4e959 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:27.750290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b463e-15c4-4941-abb7-1131a4e4e959 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:27.778641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 956/1926] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:27 2022] POST /identity/v3/users => generated 293 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:27.782679 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef0d8c-dad5-41cd-8d57-0b99a319e4a4 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:27.794043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeef0d8c-dad5-41cd-8d57-0b99a319e4a4 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:27.799479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401692d0-f072-449c-9299-834dc241f1cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:27.800210 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401692d0-f072-449c-9299-834dc241f1cb admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.800561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401692d0-f072-449c-9299-834dc241f1cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.800911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401692d0-f072-449c-9299-834dc241f1cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.801635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401692d0-f072-449c-9299-834dc241f1cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:27.803377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401692d0-f072-449c-9299-834dc241f1cb admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:27.820229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 971/1927] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:27.821467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b463e-15c4-4941-abb7-1131a4e4e959 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:27.833326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b463e-15c4-4941-abb7-1131a4e4e959 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:27.838383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512beac-e2dd-40c8-984c-389385ce6730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:27.839193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512beac-e2dd-40c8-984c-389385ce6730 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.839721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512beac-e2dd-40c8-984c-389385ce6730 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.840170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1512beac-e2dd-40c8-984c-389385ce6730 admin admin] PATH_INFO: `/v3/projects/b54ad20114bd4f87b0d7d8ceffb482e2/users/4b37df0bb8e4483895ca9af7cb989d42/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.859126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512beac-e2dd-40c8-984c-389385ce6730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54ad20114bd4f87b0d7d8ceffb482e2, user_id=4b37df0bb8e4483895ca9af7cb989d42, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:27.861974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1512beac-e2dd-40c8-984c-389385ce6730 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:27.883287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 957/1928] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:27 2022] PUT /identity/v3/projects/b54ad20114bd4f87b0d7d8ceffb482e2/users/4b37df0bb8e4483895ca9af7cb989d42/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:27.887637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401692d0-f072-449c-9299-834dc241f1cb admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:27.900210 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401692d0-f072-449c-9299-834dc241f1cb admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:27.926003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:27.978696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c5a0b-a3c6-436a-ab00-d6cffc52d1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:27.979617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c5a0b-a3c6-436a-ab00-d6cffc52d1ba admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:27.979901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c5a0b-a3c6-436a-ab00-d6cffc52d1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:27.980170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c5a0b-a3c6-436a-ab00-d6cffc52d1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:27.982403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c5a0b-a3c6-436a-ab00-d6cffc52d1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:27.984225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c5a0b-a3c6-436a-ab00-d6cffc52d1ba admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:28.000818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 972/1929] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:28.001775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512beac-e2dd-40c8-984c-389385ce6730 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:28.017061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1512beac-e2dd-40c8-984c-389385ce6730 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:28.022320 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c8963-5f2d-4541-a3ee-85282245528a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:28.025697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c8963-5f2d-4541-a3ee-85282245528a admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:28.025697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c8963-5f2d-4541-a3ee-85282245528a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:28.025697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756c8963-5f2d-4541-a3ee-85282245528a admin admin] PATH_INFO: `/v3/projects/b54ad20114bd4f87b0d7d8ceffb482e2/users/4b37df0bb8e4483895ca9af7cb989d42/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:28.026103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c8963-5f2d-4541-a3ee-85282245528a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b54ad20114bd4f87b0d7d8ceffb482e2, user_id=4b37df0bb8e4483895ca9af7cb989d42, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:28.028871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756c8963-5f2d-4541-a3ee-85282245528a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:28.042834 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 958/1930] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:28 2022] PUT /identity/v3/projects/b54ad20114bd4f87b0d7d8ceffb482e2/users/4b37df0bb8e4483895ca9af7cb989d42/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:28.796276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfd644-351b-4ca4-8a47-b7f0634a5be7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:28.796841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfd644-351b-4ca4-8a47-b7f0634a5be7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:28.796841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cfd644-351b-4ca4-8a47-b7f0634a5be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:28.826232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-38cfd644-351b-4ca4-8a47-b7f0634a5be7 None None] MFA Rules not processed for user `4b37df0bb8e4483895ca9af7cb989d42`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:28.827957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-38cfd644-351b-4ca4-8a47-b7f0634a5be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:28.926691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 973/1931] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:28.942006 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c8963-5f2d-4541-a3ee-85282245528a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:28.943929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-756c8963-5f2d-4541-a3ee-85282245528a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:29.010213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756c8963-5f2d-4541-a3ee-85282245528a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:29.014717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbee23d7-699c-4076-ade5-13f3a9d675b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:29.014717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee23d7-699c-4076-ade5-13f3a9d675b1 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:29.015021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee23d7-699c-4076-ade5-13f3a9d675b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:29.015208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbee23d7-699c-4076-ade5-13f3a9d675b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:29.075190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee23d7-699c-4076-ade5-13f3a9d675b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:29.076871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbee23d7-699c-4076-ade5-13f3a9d675b1 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:29.085873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 959/1932] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:30.473230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfd644-351b-4ca4-8a47-b7f0634a5be7 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:30.483329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cfd644-351b-4ca4-8a47-b7f0634a5be7 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:30.487706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64cd4fb-9300-49aa-b754-450765a3fcd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:30.488375 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cd4fb-9300-49aa-b754-450765a3fcd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:30.488668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cd4fb-9300-49aa-b754-450765a3fcd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:30.488937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64cd4fb-9300-49aa-b754-450765a3fcd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:30.499403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cd4fb-9300-49aa-b754-450765a3fcd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:30.502246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64cd4fb-9300-49aa-b754-450765a3fcd1 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:30.513351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 974/1933] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:30 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:31.128549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d262eff-695e-4f8d-b131-8cb3a53f386b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:31.129069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d262eff-695e-4f8d-b131-8cb3a53f386b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:31.129160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d262eff-695e-4f8d-b131-8cb3a53f386b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:31.133286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 960/1934] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 21:06:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:31.143325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9093e-d164-4cc2-ad87-2dbd624ebd8e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:31.144037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9093e-d164-4cc2-ad87-2dbd624ebd8e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:31.144507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece9093e-d164-4cc2-ad87-2dbd624ebd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:31.169027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ece9093e-d164-4cc2-ad87-2dbd624ebd8e None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:31.170797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ece9093e-d164-4cc2-ad87-2dbd624ebd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:31.404090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 975/1935] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 21:06:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 262 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:31.600281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d262eff-695e-4f8d-b131-8cb3a53f386b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:31.602360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7d262eff-695e-4f8d-b131-8cb3a53f386b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:31.637778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d262eff-695e-4f8d-b131-8cb3a53f386b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:31.651537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247d022-cc1e-4125-881f-a7ffb4ebe3e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:31.652165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247d022-cc1e-4125-881f-a7ffb4ebe3e4 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:31.652612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247d022-cc1e-4125-881f-a7ffb4ebe3e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:31.653119 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247d022-cc1e-4125-881f-a7ffb4ebe3e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:31.673302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247d022-cc1e-4125-881f-a7ffb4ebe3e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:31.675467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247d022-cc1e-4125-881f-a7ffb4ebe3e4 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:31.718297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 961/1936] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:31 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:32.446504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9093e-d164-4cc2-ad87-2dbd624ebd8e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:32.448015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ece9093e-d164-4cc2-ad87-2dbd624ebd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:32.467776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:32.519565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece9093e-d164-4cc2-ad87-2dbd624ebd8e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:32.524599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:32.525257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:32.525539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:32.525825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] PATH_INFO: `/v3/users/434e2fa3932f460ca9d7ec7e064c9738` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:32.527005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=434e2fa3932f460ca9d7ec7e064c9738)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:32.529018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:32.582863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '434e2fa3932f460ca9d7ec7e064c9738'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:32.595988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '434e2fa3932f460ca9d7ec7e064c9738'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:32.604717 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '434e2fa3932f460ca9d7ec7e064c9738'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:32.613135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '434e2fa3932f460ca9d7ec7e064c9738'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:32.613802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '434e2fa3932f460ca9d7ec7e064c9738'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:32.620032 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 976/1937] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:32 2022] DELETE /identity/v3/users/434e2fa3932f460ca9d7ec7e064c9738 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:32.624744 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d69c-1232-4734-a483-e5f2f1382a73 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:32.625232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d69c-1232-4734-a483-e5f2f1382a73 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:32.625446 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b584d69c-1232-4734-a483-e5f2f1382a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:32.644456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b584d69c-1232-4734-a483-e5f2f1382a73 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:32.645666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b584d69c-1232-4734-a483-e5f2f1382a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:32.692343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:32.708896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 962/1938] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:32.725662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:32.727297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:32.814914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4c1c27-bf82-4456-9de3-86a94d6fd1a9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:32.820210 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea58ec-128d-4086-b29b-d0bcdeca357f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:32.821059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea58ec-128d-4086-b29b-d0bcdeca357f service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:32.821571 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea58ec-128d-4086-b29b-d0bcdeca357f service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:32.822187 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ea58ec-128d-4086-b29b-d0bcdeca357f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:32.835288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea58ec-128d-4086-b29b-d0bcdeca357f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:32.837011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ea58ec-128d-4086-b29b-d0bcdeca357f service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:32.852101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 977/1939] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:33.411357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d69c-1232-4734-a483-e5f2f1382a73 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:33.413313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b584d69c-1232-4734-a483-e5f2f1382a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:33.430206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b584d69c-1232-4734-a483-e5f2f1382a73 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:33.438337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:33.439396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:33.439903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:33.440373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] PATH_INFO: `/v3/projects/274386a5a7a54d4ea447f3fde513b12d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:33.442459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=274386a5a7a54d4ea447f3fde513b12d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:33.445424 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:33.518551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '274386a5a7a54d4ea447f3fde513b12d', 'request_id': 'req-5e329cfc-7434-45de-88fa-c334bb513095'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:33.531708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '274386a5a7a54d4ea447f3fde513b12d', 'request_id': 'req-5e329cfc-7434-45de-88fa-c334bb513095'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:33.540245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '274386a5a7a54d4ea447f3fde513b12d', 'request_id': 'req-5e329cfc-7434-45de-88fa-c334bb513095'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:33.553072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] The token cache is being invalidate because project 274386a5a7a54d4ea447f3fde513b12d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:33.553366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:33.554038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:33.555564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 963/1940] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:33 2022] DELETE /identity/v3/projects/274386a5a7a54d4ea447f3fde513b12d => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:33.559542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea58ec-128d-4086-b29b-d0bcdeca357f service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:33.569984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ea58ec-128d-4086-b29b-d0bcdeca357f service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:33.627132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:33.658439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:33.659301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:33.659580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:33.659903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] PATH_INFO: `/v3/users/0f126a2ed9e949469d24f26577faf699` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:33.661662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f126a2ed9e949469d24f26577faf699)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:33.664146 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:33.719501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f126a2ed9e949469d24f26577faf699'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:33.738786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f126a2ed9e949469d24f26577faf699'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:33.743438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f126a2ed9e949469d24f26577faf699'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:33.751180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f126a2ed9e949469d24f26577faf699'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:33.751943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f126a2ed9e949469d24f26577faf699'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:33.763641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 978/1941] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:33 2022] DELETE /identity/v3/users/0f126a2ed9e949469d24f26577faf699 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:34.261350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:34.264018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:34.299949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e329cfc-7434-45de-88fa-c334bb513095 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:34.369789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:34.370551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:34.370929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:34.371267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] PATH_INFO: `/v3/projects/952c4b1c75574694bcef4fff37d27f1f` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:34.372497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=952c4b1c75574694bcef4fff37d27f1f)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:34.374911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:34.429905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '952c4b1c75574694bcef4fff37d27f1f', 'request_id': 'req-a5c77d12-7e0d-4868-adcd-b122f8b21d67'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:34.439423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '952c4b1c75574694bcef4fff37d27f1f', 'request_id': 'req-a5c77d12-7e0d-4868-adcd-b122f8b21d67'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:34.446460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '952c4b1c75574694bcef4fff37d27f1f', 'request_id': 'req-a5c77d12-7e0d-4868-adcd-b122f8b21d67'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:34.458965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] The token cache is being invalidate because project 952c4b1c75574694bcef4fff37d27f1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:34.459202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:34.459869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:34.461474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 964/1942] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:34 2022] DELETE /identity/v3/projects/952c4b1c75574694bcef4fff37d27f1f => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:34.465880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:34.467360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:34.482995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf3418f-7543-4ad5-997d-aef53218dff7 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:34.545099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:34.545865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:34.546280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:34.546627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] PATH_INFO: `/v3/users/a85fb16ae3b243759116da939ea0b4c4` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:34.547959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a85fb16ae3b243759116da939ea0b4c4)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:34.550289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:34.614380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a85fb16ae3b243759116da939ea0b4c4'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:34.629101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:34.637273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a85fb16ae3b243759116da939ea0b4c4'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:34.649088 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a85fb16ae3b243759116da939ea0b4c4'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:34.659796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a85fb16ae3b243759116da939ea0b4c4'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:34.660773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-933f0e15-5566-4bd9-b799-eb8fe89c2b69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a85fb16ae3b243759116da939ea0b4c4'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:34.667991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 979/1943] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:34 2022] DELETE /identity/v3/users/a85fb16ae3b243759116da939ea0b4c4 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:34.747829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:34.749548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:34.774099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:34.785920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c77d12-7e0d-4868-adcd-b122f8b21d67 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:34.911073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:34.912231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:34.912757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:34.913256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] PATH_INFO: `/v3/users/78a8e5d100f74994a41561e44df08bbb` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:34.914941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78a8e5d100f74994a41561e44df08bbb)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:34.918838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.008175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78a8e5d100f74994a41561e44df08bbb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.008940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78a8e5d100f74994a41561e44df08bbb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.009668 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78a8e5d100f74994a41561e44df08bbb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.033037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78a8e5d100f74994a41561e44df08bbb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.044893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78a8e5d100f74994a41561e44df08bbb'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.068138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 965/1944] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:34 2022] DELETE /identity/v3/users/78a8e5d100f74994a41561e44df08bbb => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:35.080633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad1d55-c1d9-43a8-8c81-77361f1ea21e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.081021 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad1d55-c1d9-43a8-8c81-77361f1ea21e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.081218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad1d55-c1d9-43a8-8c81-77361f1ea21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.102908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-92ad1d55-c1d9-43a8-8c81-77361f1ea21e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:35.104351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-92ad1d55-c1d9-43a8-8c81-77361f1ea21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:35.126082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.127792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:35.194261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 980/1945] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:35.201017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad1d55-c1d9-43a8-8c81-77361f1ea21e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.202440 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-92ad1d55-c1d9-43a8-8c81-77361f1ea21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:35.227206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfe7246-2fc8-4aaf-a6d9-fdb6f4882005 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:35.234053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:35.235229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.235583 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.235964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] PATH_INFO: `/v3/projects/f31a260853574c0eb1fa92a14608f31e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.237301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f31a260853574c0eb1fa92a14608f31e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:35.239825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.279114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad1d55-c1d9-43a8-8c81-77361f1ea21e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:35.284262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de7be44-6ec4-49f8-ac35-0ecf19fb2342 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:35.285381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7be44-6ec4-49f8-ac35-0ecf19fb2342 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.285902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7be44-6ec4-49f8-ac35-0ecf19fb2342 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.286409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de7be44-6ec4-49f8-ac35-0ecf19fb2342 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.292526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:35.297934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7be44-6ec4-49f8-ac35-0ecf19fb2342 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:35.299544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de7be44-6ec4-49f8-ac35-0ecf19fb2342 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.310205 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 981/1946] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:35.313792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f31a260853574c0eb1fa92a14608f31e', 'request_id': 'req-846513ba-bf13-458e-af18-a561124d23c6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.322700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f31a260853574c0eb1fa92a14608f31e', 'request_id': 'req-846513ba-bf13-458e-af18-a561124d23c6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.330005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f31a260853574c0eb1fa92a14608f31e', 'request_id': 'req-846513ba-bf13-458e-af18-a561124d23c6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.341759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] The token cache is being invalidate because project f31a260853574c0eb1fa92a14608f31e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:35.342156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.343108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-846513ba-bf13-458e-af18-a561124d23c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.351657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7a55-c879-4ea1-b774-ff64ec134a41 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.351847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7a55-c879-4ea1-b774-ff64ec134a41 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.352191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eb7a55-c879-4ea1-b774-ff64ec134a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.354928 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 966/1947] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:35 2022] DELETE /identity/v3/projects/f31a260853574c0eb1fa92a14608f31e => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:35.389043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d3eb7a55-c879-4ea1-b774-ff64ec134a41 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:35.396543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d3eb7a55-c879-4ea1-b774-ff64ec134a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:35.497777 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 982/1948] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:35.507026 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f28757-6b7a-4e64-8cae-62029397a0c5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.507314 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f28757-6b7a-4e64-8cae-62029397a0c5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.507590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f28757-6b7a-4e64-8cae-62029397a0c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.531708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-04f28757-6b7a-4e64-8cae-62029397a0c5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:35.532961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-04f28757-6b7a-4e64-8cae-62029397a0c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:35.545578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7a55-c879-4ea1-b774-ff64ec134a41 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.546233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 967/1949] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:35.566538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eb7a55-c879-4ea1-b774-ff64ec134a41 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:35.571804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a5525-0cc9-4018-b83f-0fdedaadba3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:35.572426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5525-0cc9-4018-b83f-0fdedaadba3a admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.572701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5525-0cc9-4018-b83f-0fdedaadba3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.572969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9a5525-0cc9-4018-b83f-0fdedaadba3a admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.573627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a5525-0cc9-4018-b83f-0fdedaadba3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:35.574112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a5525-0cc9-4018-b83f-0fdedaadba3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:35.576089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9a5525-0cc9-4018-b83f-0fdedaadba3a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.589364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 983/1950] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:06:35.598522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f28757-6b7a-4e64-8cae-62029397a0c5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.608656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f28757-6b7a-4e64-8cae-62029397a0c5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:35.613468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be2723-484d-4831-833e-f08e9da1e52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:35.614149 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be2723-484d-4831-833e-f08e9da1e52d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.614490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be2723-484d-4831-833e-f08e9da1e52d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.614880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3be2723-484d-4831-833e-f08e9da1e52d admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.615634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be2723-484d-4831-833e-f08e9da1e52d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:35.617614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3be2723-484d-4831-833e-f08e9da1e52d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.648377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 968/1951] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:35 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:35.652684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a5525-0cc9-4018-b83f-0fdedaadba3a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.663655 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9a5525-0cc9-4018-b83f-0fdedaadba3a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:35.668041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:35.734391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be2723-484d-4831-833e-f08e9da1e52d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.739208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d3be2723-484d-4831-833e-f08e9da1e52d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:35.754430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ef901-31ee-49bf-933a-07e5680657a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:35.756283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef901-31ee-49bf-933a-07e5680657a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.756561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef901-31ee-49bf-933a-07e5680657a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.756829 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ef901-31ee-49bf-933a-07e5680657a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.757479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ef901-31ee-49bf-933a-07e5680657a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:35.759860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ef901-31ee-49bf-933a-07e5680657a9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.785995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 984/1952] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:35 2022] POST /identity/v3/users => generated 282 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:35.790023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ef901-31ee-49bf-933a-07e5680657a9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.800941 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ef901-31ee-49bf-933a-07e5680657a9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:35.806107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58ffbd-eff4-4f5e-8e8c-4a4939f6a5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:35.806919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58ffbd-eff4-4f5e-8e8c-4a4939f6a5c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.807351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58ffbd-eff4-4f5e-8e8c-4a4939f6a5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.807624 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e58ffbd-eff4-4f5e-8e8c-4a4939f6a5c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.808292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58ffbd-eff4-4f5e-8e8c-4a4939f6a5c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:35.809894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e58ffbd-eff4-4f5e-8e8c-4a4939f6a5c2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.824542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 985/1953] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:06:35.825786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58ffbd-eff4-4f5e-8e8c-4a4939f6a5c2 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.837318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e58ffbd-eff4-4f5e-8e8c-4a4939f6a5c2 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:35.841005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3be2723-484d-4831-833e-f08e9da1e52d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:35.842013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc017f-659a-4658-a873-0e2bf49244a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:35.842715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc017f-659a-4658-a873-0e2bf49244a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.844055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc017f-659a-4658-a873-0e2bf49244a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.844055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc017f-659a-4658-a873-0e2bf49244a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.844647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc017f-659a-4658-a873-0e2bf49244a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:35.846383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc017f-659a-4658-a873-0e2bf49244a3 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.855133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:35.855909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.856265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.856672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] PATH_INFO: `/v3/projects/566b79164e9f493aa2bfe927f418be61` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.858405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=566b79164e9f493aa2bfe927f418be61)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:35.858532 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 986/1954] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:35.860759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.864442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc017f-659a-4658-a873-0e2bf49244a3 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.881399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc017f-659a-4658-a873-0e2bf49244a3 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:35.886945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f716137-d458-40bb-92b0-eea3a3cdc09e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:35.887616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f716137-d458-40bb-92b0-eea3a3cdc09e admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.887886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f716137-d458-40bb-92b0-eea3a3cdc09e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.888216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f716137-d458-40bb-92b0-eea3a3cdc09e admin admin] PATH_INFO: `/v3/projects/e0643ea7bd8e469d894f669e5ededd76/users/b9c0e2deb9e34c88beee125883190f28/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.907058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f716137-d458-40bb-92b0-eea3a3cdc09e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0643ea7bd8e469d894f669e5ededd76, user_id=b9c0e2deb9e34c88beee125883190f28, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:35.910074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f716137-d458-40bb-92b0-eea3a3cdc09e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:35.924875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '566b79164e9f493aa2bfe927f418be61', 'request_id': 'req-94d0c98a-0a86-4445-895c-063f17578ac4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.930407 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 987/1955] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:35 2022] PUT /identity/v3/projects/e0643ea7bd8e469d894f669e5ededd76/users/b9c0e2deb9e34c88beee125883190f28/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:35.941579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '566b79164e9f493aa2bfe927f418be61', 'request_id': 'req-94d0c98a-0a86-4445-895c-063f17578ac4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.942480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdc229-7212-4be8-976b-c85db2c8dc02 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:35.943276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdc229-7212-4be8-976b-c85db2c8dc02 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:35.943714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bdc229-7212-4be8-976b-c85db2c8dc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:35.949103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '566b79164e9f493aa2bfe927f418be61', 'request_id': 'req-94d0c98a-0a86-4445-895c-063f17578ac4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.964825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] The token cache is being invalidate because project 566b79164e9f493aa2bfe927f418be61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:35.965120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.965790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:35.968602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 969/1956] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:35 2022] DELETE /identity/v3/projects/566b79164e9f493aa2bfe927f418be61 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:35.972861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:35.974681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:35.978670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-e4bdc229-7212-4be8-976b-c85db2c8dc02 None None] MFA Rules not processed for user `b9c0e2deb9e34c88beee125883190f28`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:35.979923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e4bdc229-7212-4be8-976b-c85db2c8dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:35.993369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:36.060722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d0c98a-0a86-4445-895c-063f17578ac4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:36.080336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 988/1957] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:36.094278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdc229-7212-4be8-976b-c85db2c8dc02 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:36.095952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e4bdc229-7212-4be8-976b-c85db2c8dc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:36.135658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:36.136305 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:36.136581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:36.136975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] PATH_INFO: `/v3/users/3b6c9079b23f48c38587e4772dfcf6a7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:36.138228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b6c9079b23f48c38587e4772dfcf6a7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:36.140397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:36.148635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:36.166135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bdc229-7212-4be8-976b-c85db2c8dc02 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:36.170603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e59e0-e751-4656-be65-7f6dd3760f84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:36.171428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e59e0-e751-4656-be65-7f6dd3760f84 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:36.172266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e59e0-e751-4656-be65-7f6dd3760f84 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:36.172266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1e59e0-e751-4656-be65-7f6dd3760f84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:36.182677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e59e0-e751-4656-be65-7f6dd3760f84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:36.184260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1e59e0-e751-4656-be65-7f6dd3760f84 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:36.194267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 989/1958] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:36.200297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b6c9079b23f48c38587e4772dfcf6a7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:36.201042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b6c9079b23f48c38587e4772dfcf6a7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:36.201945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b6c9079b23f48c38587e4772dfcf6a7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:36.217840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b6c9079b23f48c38587e4772dfcf6a7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:36.229947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-95c7365d-a705-4eb0-a891-9e2d101c0428 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b6c9079b23f48c38587e4772dfcf6a7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:36.248511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 970/1959] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:35 2022] DELETE /identity/v3/users/3b6c9079b23f48c38587e4772dfcf6a7 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:36.577456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e59e0-e751-4656-be65-7f6dd3760f84 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:36.611023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1e59e0-e751-4656-be65-7f6dd3760f84 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:36.674820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:36.675591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:36.675798 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:36.676069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] PATH_INFO: `/v3/projects/04998709e11c413bb8d0a9f109adbc1b` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:36.677273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] RBAC: Authorizing `identity:delete_project(project_id=04998709e11c413bb8d0a9f109adbc1b)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:36.679704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:36.731272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04998709e11c413bb8d0a9f109adbc1b', 'request_id': 'req-d20743bf-f742-4b12-b776-dcd369b3117f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:36.738074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04998709e11c413bb8d0a9f109adbc1b', 'request_id': 'req-d20743bf-f742-4b12-b776-dcd369b3117f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:36.747134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04998709e11c413bb8d0a9f109adbc1b', 'request_id': 'req-d20743bf-f742-4b12-b776-dcd369b3117f'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:36.778418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] The token cache is being invalidate because project 04998709e11c413bb8d0a9f109adbc1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:36.779105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:36.779682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d20743bf-f742-4b12-b776-dcd369b3117f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:36.782105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 990/1960] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:36 2022] DELETE /identity/v3/projects/04998709e11c413bb8d0a9f109adbc1b => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:36.788483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0cf7b-4a49-4d1f-8a00-c4582b553a48 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:36.788948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0cf7b-4a49-4d1f-8a00-c4582b553a48 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:36.789165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca0cf7b-4a49-4d1f-8a00-c4582b553a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:36.812652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0ca0cf7b-4a49-4d1f-8a00-c4582b553a48 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:36.813878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0ca0cf7b-4a49-4d1f-8a00-c4582b553a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:36.854867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:36.878478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 971/1961] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:36.886471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99293b1-de5f-4941-9f76-2e297f764ea7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:36.886778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99293b1-de5f-4941-9f76-2e297f764ea7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:36.887062 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99293b1-de5f-4941-9f76-2e297f764ea7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:36.909664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-f99293b1-de5f-4941-9f76-2e297f764ea7 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:36.910942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f99293b1-de5f-4941-9f76-2e297f764ea7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:36.920914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 991/1962] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:36.925620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0cf7b-4a49-4d1f-8a00-c4582b553a48 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:36.937076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca0cf7b-4a49-4d1f-8a00-c4582b553a48 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:36.942214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9621b-9868-40c6-83b4-dc442294856b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:36.942870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9621b-9868-40c6-83b4-dc442294856b admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:36.943151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9621b-9868-40c6-83b4-dc442294856b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:36.943426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9621b-9868-40c6-83b4-dc442294856b admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:36.944079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9621b-9868-40c6-83b4-dc442294856b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:36.944382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9621b-9868-40c6-83b4-dc442294856b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:36.946034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9621b-9868-40c6-83b4-dc442294856b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:36.960226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 972/1963] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:06:36.965207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99293b1-de5f-4941-9f76-2e297f764ea7 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:36.979859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99293b1-de5f-4941-9f76-2e297f764ea7 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:36.987450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8983a-0061-4930-9fca-384c83003608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:36.988064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8983a-0061-4930-9fca-384c83003608 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:36.988339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8983a-0061-4930-9fca-384c83003608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:36.988606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e8983a-0061-4930-9fca-384c83003608 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:36.989242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8983a-0061-4930-9fca-384c83003608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:36.991218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e8983a-0061-4930-9fca-384c83003608 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:37.024367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 992/1964] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:36 2022] POST /identity/v3/projects => generated 377 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:37.028788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9621b-9868-40c6-83b4-dc442294856b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:37.039122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9621b-9868-40c6-83b4-dc442294856b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:37.099292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c30c57-583c-40ff-9316-8031e9609a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:37.099924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c30c57-583c-40ff-9316-8031e9609a13 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:37.100173 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c30c57-583c-40ff-9316-8031e9609a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:37.100460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c30c57-583c-40ff-9316-8031e9609a13 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:37.101089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c30c57-583c-40ff-9316-8031e9609a13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:37.103041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c30c57-583c-40ff-9316-8031e9609a13 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:37.125902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 973/1965] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:37 2022] POST /identity/v3/users => generated 289 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:37.133266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8983a-0061-4930-9fca-384c83003608 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:37.144681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e8983a-0061-4930-9fca-384c83003608 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:37.149877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988553c-db64-4a41-95cb-e22ad3320324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:37.150516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988553c-db64-4a41-95cb-e22ad3320324 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:37.150819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988553c-db64-4a41-95cb-e22ad3320324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:37.151093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988553c-db64-4a41-95cb-e22ad3320324 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:37.151734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988553c-db64-4a41-95cb-e22ad3320324 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:37.153342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988553c-db64-4a41-95cb-e22ad3320324 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:37.163902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 993/1966] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:06:37.168135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c30c57-583c-40ff-9316-8031e9609a13 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:37.178318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c30c57-583c-40ff-9316-8031e9609a13 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:37.183027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ba590e-f2b7-4680-b526-0c26262363d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:37.183627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba590e-f2b7-4680-b526-0c26262363d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:37.183910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba590e-f2b7-4680-b526-0c26262363d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:37.184174 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ba590e-f2b7-4680-b526-0c26262363d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:37.184848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba590e-f2b7-4680-b526-0c26262363d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:37.186539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ba590e-f2b7-4680-b526-0c26262363d9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:37.197407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 974/1967] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:37.201680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988553c-db64-4a41-95cb-e22ad3320324 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:37.214096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988553c-db64-4a41-95cb-e22ad3320324 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:37.220997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7d0ac-fd8e-4a90-bf61-ffd8c7f26b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:37.221585 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7d0ac-fd8e-4a90-bf61-ffd8c7f26b1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:37.221866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7d0ac-fd8e-4a90-bf61-ffd8c7f26b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:37.222137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e7d0ac-fd8e-4a90-bf61-ffd8c7f26b1d admin admin] PATH_INFO: `/v3/projects/47f0bc6b88194167a49440c428dc99cb/users/3006c5237b574c6db99e12aa6b454e92/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:37.239166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7d0ac-fd8e-4a90-bf61-ffd8c7f26b1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=47f0bc6b88194167a49440c428dc99cb, user_id=3006c5237b574c6db99e12aa6b454e92, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:37.241940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e7d0ac-fd8e-4a90-bf61-ffd8c7f26b1d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:37.256729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 994/1968] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:37 2022] PUT /identity/v3/projects/47f0bc6b88194167a49440c428dc99cb/users/3006c5237b574c6db99e12aa6b454e92/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:37.269078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22bd6-7310-4009-9206-f55dc35364f3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:37.269492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22bd6-7310-4009-9206-f55dc35364f3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:37.269934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d22bd6-7310-4009-9206-f55dc35364f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:37.300139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-33d22bd6-7310-4009-9206-f55dc35364f3 None None] MFA Rules not processed for user `3006c5237b574c6db99e12aa6b454e92`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:37.301387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-33d22bd6-7310-4009-9206-f55dc35364f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:37.371120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 975/1969] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:37 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:37.382578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7d0ac-fd8e-4a90-bf61-ffd8c7f26b1d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:37.384418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a6e7d0ac-fd8e-4a90-bf61-ffd8c7f26b1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:37.399978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:37.469131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e7d0ac-fd8e-4a90-bf61-ffd8c7f26b1d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:37.473041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f096de-a8b2-4c0a-8c69-5c456c10f837 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7074acac73904bab8399f223bd662863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:37.473592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f096de-a8b2-4c0a-8c69-5c456c10f837 service glance] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:37.473868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f096de-a8b2-4c0a-8c69-5c456c10f837 service glance] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:37.474128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f096de-a8b2-4c0a-8c69-5c456c10f837 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:37.482571 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f096de-a8b2-4c0a-8c69-5c456c10f837 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:37.484227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f096de-a8b2-4c0a-8c69-5c456c10f837 service glance] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:37.493162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 995/1970] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:37 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:42.271001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d22bd6-7310-4009-9206-f55dc35364f3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:42.272479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-33d22bd6-7310-4009-9206-f55dc35364f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:42.318084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:42.368783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d22bd6-7310-4009-9206-f55dc35364f3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:42.379120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:42.379120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:42.379120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:42.379120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] PATH_INFO: `/v3/users/a6ec317f9ac5429289a949264ce1d780` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:42.381836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6ec317f9ac5429289a949264ce1d780)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:42.386003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:42.461942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6ec317f9ac5429289a949264ce1d780'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:42.462622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6ec317f9ac5429289a949264ce1d780'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:42.463310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6ec317f9ac5429289a949264ce1d780'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:42.478608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6ec317f9ac5429289a949264ce1d780'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:42.488600 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6ec317f9ac5429289a949264ce1d780'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:42.509653 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 976/1971] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:42 2022] DELETE /identity/v3/users/a6ec317f9ac5429289a949264ce1d780 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:42.515299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ebff0-3c7f-4a11-a7e4-c545eccd060a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:42.516218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ebff0-3c7f-4a11-a7e4-c545eccd060a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:42.516789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ebff0-3c7f-4a11-a7e4-c545eccd060a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:42.542855 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ca8ebff0-3c7f-4a11-a7e4-c545eccd060a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:42.545204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ca8ebff0-3c7f-4a11-a7e4-c545eccd060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:42.635699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 996/1972] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:42.647114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:42.648892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:42.791393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43129c85-eea0-4aa9-a4f8-b0ae1d7bcff4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:42.800149 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2e837-eb27-499f-9c9d-2eec02f5f691 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:42.800894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2e837-eb27-499f-9c9d-2eec02f5f691 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:42.801423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2e837-eb27-499f-9c9d-2eec02f5f691 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:42.801801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc2e837-eb27-499f-9c9d-2eec02f5f691 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:42.814048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2e837-eb27-499f-9c9d-2eec02f5f691 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:42.815809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc2e837-eb27-499f-9c9d-2eec02f5f691 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:42.854682 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 977/1973] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:43.524705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ebff0-3c7f-4a11-a7e4-c545eccd060a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:43.526942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ca8ebff0-3c7f-4a11-a7e4-c545eccd060a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:43.552828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ebff0-3c7f-4a11-a7e4-c545eccd060a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:43.558903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:43.559696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:43.560087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:43.560471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] PATH_INFO: `/v3/projects/0a4d1645413a4f839a50224d31f58e21` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:43.561904 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a4d1645413a4f839a50224d31f58e21)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:43.564931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:43.625790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a4d1645413a4f839a50224d31f58e21', 'request_id': 'req-775713c4-bf6d-41f0-9f68-3511e96e7ea6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:43.635345 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a4d1645413a4f839a50224d31f58e21', 'request_id': 'req-775713c4-bf6d-41f0-9f68-3511e96e7ea6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:43.644427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a4d1645413a4f839a50224d31f58e21', 'request_id': 'req-775713c4-bf6d-41f0-9f68-3511e96e7ea6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:43.656488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] The token cache is being invalidate because project 0a4d1645413a4f839a50224d31f58e21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:43.656756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:43.657999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:43.659745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 997/1974] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:43 2022] DELETE /identity/v3/projects/0a4d1645413a4f839a50224d31f58e21 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:43.663683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2e837-eb27-499f-9c9d-2eec02f5f691 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:43.674209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc2e837-eb27-499f-9c9d-2eec02f5f691 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:43.736531 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:43.737636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:43.737927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:43.738182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] PATH_INFO: `/v3/users/a5f65a6fc4c04bacbf5561a76f2ae496` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:43.739410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5f65a6fc4c04bacbf5561a76f2ae496)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:43.741346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:43.742999 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:43.830816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5f65a6fc4c04bacbf5561a76f2ae496'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:43.831843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5f65a6fc4c04bacbf5561a76f2ae496'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:43.833330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5f65a6fc4c04bacbf5561a76f2ae496'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:43.885246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5f65a6fc4c04bacbf5561a76f2ae496'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:43.897148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-f2e9fb49-ec18-41ab-9ad2-4464c6a16133 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5f65a6fc4c04bacbf5561a76f2ae496'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:43.915580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 978/1975] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:43 2022] DELETE /identity/v3/users/a5f65a6fc4c04bacbf5561a76f2ae496 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:44.331312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:44.333032 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:44.375620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775713c4-bf6d-41f0-9f68-3511e96e7ea6 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:44.400329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:44.509774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:44.510512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:44.510875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:44.511209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] PATH_INFO: `/v3/projects/4c095327aba549b49e0f21be40ac3c91` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:44.512699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c095327aba549b49e0f21be40ac3c91)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:44.515982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:44.577525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c095327aba549b49e0f21be40ac3c91', 'request_id': 'req-9178fdb4-4f8a-4163-9878-96afc20cb0bd'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:44.587707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c095327aba549b49e0f21be40ac3c91', 'request_id': 'req-9178fdb4-4f8a-4163-9878-96afc20cb0bd'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:44.600505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c095327aba549b49e0f21be40ac3c91', 'request_id': 'req-9178fdb4-4f8a-4163-9878-96afc20cb0bd'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:44.616027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] The token cache is being invalidate because project 4c095327aba549b49e0f21be40ac3c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:44.616337 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:44.616992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9178fdb4-4f8a-4163-9878-96afc20cb0bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:44.618641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 998/1976] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:44 2022] DELETE /identity/v3/projects/4c095327aba549b49e0f21be40ac3c91 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:44.623928 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d3159-135d-4d8c-833c-0613482519b2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:44.624209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d3159-135d-4d8c-833c-0613482519b2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:44.624512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d3159-135d-4d8c-833c-0613482519b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:44.665212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a29d3159-135d-4d8c-833c-0613482519b2 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:44.669093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a29d3159-135d-4d8c-833c-0613482519b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:44.797492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 979/1977] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:44.807940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a56e-3a6d-41b1-afde-36b118dd1887 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:44.808234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a56e-3a6d-41b1-afde-36b118dd1887 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:44.808512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa8a56e-3a6d-41b1-afde-36b118dd1887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:44.841048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-bfa8a56e-3a6d-41b1-afde-36b118dd1887 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:44.842454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-bfa8a56e-3a6d-41b1-afde-36b118dd1887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:44.852852 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 999/1978] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:44.857444 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d3159-135d-4d8c-833c-0613482519b2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:44.869548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d3159-135d-4d8c-833c-0613482519b2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:44.875783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403faa6-96cf-4424-8035-3986def25a54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:44.876486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403faa6-96cf-4424-8035-3986def25a54 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:44.876829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403faa6-96cf-4424-8035-3986def25a54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:44.877187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5403faa6-96cf-4424-8035-3986def25a54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:44.877916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403faa6-96cf-4424-8035-3986def25a54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:44.878224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403faa6-96cf-4424-8035-3986def25a54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:44.880650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5403faa6-96cf-4424-8035-3986def25a54 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:44.894239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 980/1979] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:06:44.898875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8a56e-3a6d-41b1-afde-36b118dd1887 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:44.908416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa8a56e-3a6d-41b1-afde-36b118dd1887 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:44.913105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638930-9705-4e76-9f5a-638fda49e4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:44.913768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638930-9705-4e76-9f5a-638fda49e4fe admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:44.914138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638930-9705-4e76-9f5a-638fda49e4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:44.914409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31638930-9705-4e76-9f5a-638fda49e4fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:44.915067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31638930-9705-4e76-9f5a-638fda49e4fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:44.917030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31638930-9705-4e76-9f5a-638fda49e4fe admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:44.945414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1000/1980] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:44 2022] POST /identity/v3/projects => generated 381 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:44.951714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403faa6-96cf-4424-8035-3986def25a54 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:44.968375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5403faa6-96cf-4424-8035-3986def25a54 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.028735 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f9954-897d-489a-ba1c-c5d5ae2d60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.029329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f9954-897d-489a-ba1c-c5d5ae2d60cf admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.029691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f9954-897d-489a-ba1c-c5d5ae2d60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.029948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5f9954-897d-489a-ba1c-c5d5ae2d60cf admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.030684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f9954-897d-489a-ba1c-c5d5ae2d60cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.032801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5f9954-897d-489a-ba1c-c5d5ae2d60cf admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.045042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:45.062456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 981/1981] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:44 2022] POST /identity/v3/users => generated 291 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:45.067956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638930-9705-4e76-9f5a-638fda49e4fe admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:45.082642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31638930-9705-4e76-9f5a-638fda49e4fe admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.088034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773d712-7cba-4f17-96cf-67eec9c8e748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.088644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773d712-7cba-4f17-96cf-67eec9c8e748 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.088922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773d712-7cba-4f17-96cf-67eec9c8e748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.089191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0773d712-7cba-4f17-96cf-67eec9c8e748 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.089839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773d712-7cba-4f17-96cf-67eec9c8e748 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.091489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0773d712-7cba-4f17-96cf-67eec9c8e748 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.102419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1001/1982] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:45.106985 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f9954-897d-489a-ba1c-c5d5ae2d60cf admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:45.119346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5f9954-897d-489a-ba1c-c5d5ae2d60cf admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.127341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befd8564-b2d6-4193-afa5-66334a8c8a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.127964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd8564-b2d6-4193-afa5-66334a8c8a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.128246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd8564-b2d6-4193-afa5-66334a8c8a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.128518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befd8564-b2d6-4193-afa5-66334a8c8a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.129236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd8564-b2d6-4193-afa5-66334a8c8a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.130888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befd8564-b2d6-4193-afa5-66334a8c8a43 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.143300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 982/1983] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:45.148010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773d712-7cba-4f17-96cf-67eec9c8e748 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:45.158989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0773d712-7cba-4f17-96cf-67eec9c8e748 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.164053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65af5de-1735-4d5a-b871-7879bf330a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.164760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65af5de-1735-4d5a-b871-7879bf330a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.165073 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65af5de-1735-4d5a-b871-7879bf330a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.165301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65af5de-1735-4d5a-b871-7879bf330a76 admin admin] PATH_INFO: `/v3/projects/2de02f2706394e8692065b7a80aae7ed/users/9f506692bc5e440788ed699494e052d6/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.185026 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65af5de-1735-4d5a-b871-7879bf330a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de02f2706394e8692065b7a80aae7ed, user_id=9f506692bc5e440788ed699494e052d6, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.188983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65af5de-1735-4d5a-b871-7879bf330a76 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.210150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1002/1984] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:45 2022] PUT /identity/v3/projects/2de02f2706394e8692065b7a80aae7ed/users/9f506692bc5e440788ed699494e052d6/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:45.222016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e5e5d-af44-4bb3-92c0-855ccc9abbd7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.222330 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e5e5d-af44-4bb3-92c0-855ccc9abbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.222605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494e5e5d-af44-4bb3-92c0-855ccc9abbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.255145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-494e5e5d-af44-4bb3-92c0-855ccc9abbd7 None None] MFA Rules not processed for user `9f506692bc5e440788ed699494e052d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:45.256369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-494e5e5d-af44-4bb3-92c0-855ccc9abbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:45.331318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 983/1985] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:45.335995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65af5de-1735-4d5a-b871-7879bf330a76 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:45.384593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:45.406107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65af5de-1735-4d5a-b871-7879bf330a76 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.410888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c52842-f527-495b-af4d-e55951a638a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.411627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c52842-f527-495b-af4d-e55951a638a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.411905 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c52842-f527-495b-af4d-e55951a638a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.412160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c52842-f527-495b-af4d-e55951a638a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.412830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c52842-f527-495b-af4d-e55951a638a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.415114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c52842-f527-495b-af4d-e55951a638a1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.446018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1003/1986] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:45 2022] POST /identity/v3/projects => generated 381 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:45.450511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e5e5d-af44-4bb3-92c0-855ccc9abbd7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:45.463987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494e5e5d-af44-4bb3-92c0-855ccc9abbd7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.523908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08154bd-fde4-4e01-9952-2020c813527e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.524540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08154bd-fde4-4e01-9952-2020c813527e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.524802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08154bd-fde4-4e01-9952-2020c813527e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.525078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08154bd-fde4-4e01-9952-2020c813527e admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.525731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08154bd-fde4-4e01-9952-2020c813527e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.528076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08154bd-fde4-4e01-9952-2020c813527e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.553641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 984/1987] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:45 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:45.558177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c52842-f527-495b-af4d-e55951a638a1 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:45.570029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c52842-f527-495b-af4d-e55951a638a1 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.575164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21acb72-069f-4399-a24b-0dfa52dc819a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.575869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21acb72-069f-4399-a24b-0dfa52dc819a admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.576230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21acb72-069f-4399-a24b-0dfa52dc819a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.576575 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21acb72-069f-4399-a24b-0dfa52dc819a admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.577473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21acb72-069f-4399-a24b-0dfa52dc819a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.579228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21acb72-069f-4399-a24b-0dfa52dc819a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.590635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1004/1988] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:45.596555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08154bd-fde4-4e01-9952-2020c813527e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:45.610055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08154bd-fde4-4e01-9952-2020c813527e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.615610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5afa5-76b1-4260-8cc3-5f9511a5c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.616283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5afa5-76b1-4260-8cc3-5f9511a5c7d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.616564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5afa5-76b1-4260-8cc3-5f9511a5c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.616838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b5afa5-76b1-4260-8cc3-5f9511a5c7d6 admin admin] PATH_INFO: `/v3/projects/c2594696293e412cbf9faaa2aa2c78a2/users/04e9bb7fb71d4218b70723a959b975e7/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.637165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5afa5-76b1-4260-8cc3-5f9511a5c7d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2594696293e412cbf9faaa2aa2c78a2, user_id=04e9bb7fb71d4218b70723a959b975e7, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.642008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b5afa5-76b1-4260-8cc3-5f9511a5c7d6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.663349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 985/1989] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:45 2022] PUT /identity/v3/projects/c2594696293e412cbf9faaa2aa2c78a2/users/04e9bb7fb71d4218b70723a959b975e7/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:45.667534 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21acb72-069f-4399-a24b-0dfa52dc819a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:45.677776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21acb72-069f-4399-a24b-0dfa52dc819a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.739293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f3ae30-544d-43d8-b069-cce1f10bb06b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.739923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3ae30-544d-43d8-b069-cce1f10bb06b admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.740199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3ae30-544d-43d8-b069-cce1f10bb06b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.740465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3ae30-544d-43d8-b069-cce1f10bb06b admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.741138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3ae30-544d-43d8-b069-cce1f10bb06b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.743035 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f3ae30-544d-43d8-b069-cce1f10bb06b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.756172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1005/1990] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:45 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:06:45.765635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5afa5-76b1-4260-8cc3-5f9511a5c7d6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:45.780009 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b5afa5-76b1-4260-8cc3-5f9511a5c7d6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:45.785257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45fe20-91dd-469f-b10e-e7b34c61fc47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:45.785949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45fe20-91dd-469f-b10e-e7b34c61fc47 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.786210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45fe20-91dd-469f-b10e-e7b34c61fc47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.786480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d45fe20-91dd-469f-b10e-e7b34c61fc47 admin admin] PATH_INFO: `/v3/projects/c2594696293e412cbf9faaa2aa2c78a2/users/04e9bb7fb71d4218b70723a959b975e7/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.788846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45fe20-91dd-469f-b10e-e7b34c61fc47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2594696293e412cbf9faaa2aa2c78a2, user_id=04e9bb7fb71d4218b70723a959b975e7, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:45.791550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d45fe20-91dd-469f-b10e-e7b34c61fc47 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:45.805574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 986/1991] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:45 2022] PUT /identity/v3/projects/c2594696293e412cbf9faaa2aa2c78a2/users/04e9bb7fb71d4218b70723a959b975e7/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:45.818399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f95f8-0df8-4a74-83a7-5ffb4caa8120 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:45.821010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f95f8-0df8-4a74-83a7-5ffb4caa8120 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:45.821325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376f95f8-0df8-4a74-83a7-5ffb4caa8120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:45.869340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-376f95f8-0df8-4a74-83a7-5ffb4caa8120 None None] MFA Rules not processed for user `04e9bb7fb71d4218b70723a959b975e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:45.870809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-376f95f8-0df8-4a74-83a7-5ffb4caa8120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:45.988110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1006/1992] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:45 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:46.000846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45fe20-91dd-469f-b10e-e7b34c61fc47 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:46.002583 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0d45fe20-91dd-469f-b10e-e7b34c61fc47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:46.043394 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:46.077271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d45fe20-91dd-469f-b10e-e7b34c61fc47 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:46.081920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e05216-4192-419f-a8cc-fc5d241d1c8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:46.083382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e05216-4192-419f-a8cc-fc5d241d1c8b service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:46.084100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e05216-4192-419f-a8cc-fc5d241d1c8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:46.085681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e05216-4192-419f-a8cc-fc5d241d1c8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:46.099906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e05216-4192-419f-a8cc-fc5d241d1c8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:46.103652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e05216-4192-419f-a8cc-fc5d241d1c8b service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:46.117224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 987/1993] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:45 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:46.259651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f95f8-0df8-4a74-83a7-5ffb4caa8120 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:46.261743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-376f95f8-0df8-4a74-83a7-5ffb4caa8120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:46.275367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376f95f8-0df8-4a74-83a7-5ffb4caa8120 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:46.280309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b2bb5-1fa7-4d73-873a-7ea72fee9ba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:46.281164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b2bb5-1fa7-4d73-873a-7ea72fee9ba1 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:46.281662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b2bb5-1fa7-4d73-873a-7ea72fee9ba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:46.282104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b2bb5-1fa7-4d73-873a-7ea72fee9ba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:46.328895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:46.362225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b2bb5-1fa7-4d73-873a-7ea72fee9ba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:46.364096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b2bb5-1fa7-4d73-873a-7ea72fee9ba1 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:46.381762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1007/1994] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:46 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:46.846506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29505e79-0d46-4435-974f-1f9682e5c97b None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:46.847085 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29505e79-0d46-4435-974f-1f9682e5c97b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:46.847214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29505e79-0d46-4435-974f-1f9682e5c97b None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:46.848687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 988/1995] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 21:06:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:06:46.858170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f54130-b4bc-40e2-9ee2-32ead4b81a42 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:46.858851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f54130-b4bc-40e2-9ee2-32ead4b81a42 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:46.858851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f54130-b4bc-40e2-9ee2-32ead4b81a42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:46.879587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-c5f54130-b4bc-40e2-9ee2-32ead4b81a42 None None] MFA Rules not processed for user `16a4ba52fe124009a570fd1408903cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:46.880817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c5f54130-b4bc-40e2-9ee2-32ead4b81a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:46.968594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1008/1996] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 21:06:46 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:46.985791 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29505e79-0d46-4435-974f-1f9682e5c97b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:46.985791 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-29505e79-0d46-4435-974f-1f9682e5c97b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:46.998701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29505e79-0d46-4435-974f-1f9682e5c97b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:47.003795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5794e3-f1bc-4f69-9fea-711ef93d1622 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:47.004548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5794e3-f1bc-4f69-9fea-711ef93d1622 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:47.004908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5794e3-f1bc-4f69-9fea-711ef93d1622 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:47.005171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5794e3-f1bc-4f69-9fea-711ef93d1622 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:47.014175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5794e3-f1bc-4f69-9fea-711ef93d1622 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:47.015828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5794e3-f1bc-4f69-9fea-711ef93d1622 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:47.026957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 989/1997] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:06:47.476941 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f54130-b4bc-40e2-9ee2-32ead4b81a42 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:47.478488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c5f54130-b4bc-40e2-9ee2-32ead4b81a42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:47.543574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f54130-b4bc-40e2-9ee2-32ead4b81a42 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:47.548679 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:47.549311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:47.549587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:47.549854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] PATH_INFO: `/v3/users/f788306b055f42bdbdc82392f2c985d8` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:47.550989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f788306b055f42bdbdc82392f2c985d8)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:47.552939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:47.605931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f788306b055f42bdbdc82392f2c985d8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:47.618567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f788306b055f42bdbdc82392f2c985d8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:47.628321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f788306b055f42bdbdc82392f2c985d8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:47.630711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:47.637505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f788306b055f42bdbdc82392f2c985d8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:47.638291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f788306b055f42bdbdc82392f2c985d8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:47.646089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1009/1998] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:47 2022] DELETE /identity/v3/users/f788306b055f42bdbdc82392f2c985d8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:47.836512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5794e3-f1bc-4f69-9fea-711ef93d1622 service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:47.847449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5794e3-f1bc-4f69-9fea-711ef93d1622 service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:47.905413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:47.905796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:47.906078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:47.906353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] PATH_INFO: `/v3/projects/128da58fcffa44c89ab3f04be90aa76a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:47.907517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=128da58fcffa44c89ab3f04be90aa76a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:47.909455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:47.961804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128da58fcffa44c89ab3f04be90aa76a', 'request_id': 'req-a835d68b-cca1-44f5-b9cd-06a272bba383'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:47.969539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128da58fcffa44c89ab3f04be90aa76a', 'request_id': 'req-a835d68b-cca1-44f5-b9cd-06a272bba383'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:47.975829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128da58fcffa44c89ab3f04be90aa76a', 'request_id': 'req-a835d68b-cca1-44f5-b9cd-06a272bba383'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:47.987650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] The token cache is being invalidate because project 128da58fcffa44c89ab3f04be90aa76a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:47.987940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:47.988785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:47.990482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 990/1999] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:47 2022] DELETE /identity/v3/projects/128da58fcffa44c89ab3f04be90aa76a => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:47.994516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:47.996098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:48.010255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec6056-85b8-4ca0-b907-c93995bb8d55 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:48.069878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:48.070442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:48.070754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:48.071053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] PATH_INFO: `/v3/users/4b37df0bb8e4483895ca9af7cb989d42` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:48.072199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b37df0bb8e4483895ca9af7cb989d42)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:48.074141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:48.124727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b37df0bb8e4483895ca9af7cb989d42'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:48.137612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b37df0bb8e4483895ca9af7cb989d42'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:48.146587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b37df0bb8e4483895ca9af7cb989d42'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:48.153660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b37df0bb8e4483895ca9af7cb989d42'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:48.154299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-47c81584-bab7-42f7-934b-bdd572e1f9e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b37df0bb8e4483895ca9af7cb989d42'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:48.162094 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1010/2000] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:47 2022] DELETE /identity/v3/users/4b37df0bb8e4483895ca9af7cb989d42 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:48.358379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:48.360022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:48.376111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a835d68b-cca1-44f5-b9cd-06a272bba383 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:48.426521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:48.443348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:48.444024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:48.444317 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:48.444586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] PATH_INFO: `/v3/projects/b54ad20114bd4f87b0d7d8ceffb482e2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:48.445832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b54ad20114bd4f87b0d7d8ceffb482e2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:48.447847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:48.496165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b54ad20114bd4f87b0d7d8ceffb482e2', 'request_id': 'req-5ff3145b-5152-4254-a7b2-c0a36361bb3f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:48.504360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b54ad20114bd4f87b0d7d8ceffb482e2', 'request_id': 'req-5ff3145b-5152-4254-a7b2-c0a36361bb3f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:48.512958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b54ad20114bd4f87b0d7d8ceffb482e2', 'request_id': 'req-5ff3145b-5152-4254-a7b2-c0a36361bb3f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:48.525089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] The token cache is being invalidate because project b54ad20114bd4f87b0d7d8ceffb482e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:48.525384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:48.526037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5ff3145b-5152-4254-a7b2-c0a36361bb3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:48.527577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 991/2001] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:48 2022] DELETE /identity/v3/projects/b54ad20114bd4f87b0d7d8ceffb482e2 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:48.534733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a88d-fd51-4419-a545-04efc4e0a924 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:48.535056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a88d-fd51-4419-a545-04efc4e0a924 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:48.535336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f4a88d-fd51-4419-a545-04efc4e0a924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:48.556107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-17f4a88d-fd51-4419-a545-04efc4e0a924 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:48.557325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-17f4a88d-fd51-4419-a545-04efc4e0a924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:48.620945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1011/2002] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:48.629410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a80e-83b6-4226-b492-102775ca86b9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:48.629698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a80e-83b6-4226-b492-102775ca86b9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:48.629976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e931a80e-83b6-4226-b492-102775ca86b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:48.652654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-e931a80e-83b6-4226-b492-102775ca86b9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:48.654140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e931a80e-83b6-4226-b492-102775ca86b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:48.665633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 992/2003] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:48.670061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4a88d-fd51-4419-a545-04efc4e0a924 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:48.695584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f4a88d-fd51-4419-a545-04efc4e0a924 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:48.700578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c81c84-d473-4799-bfea-44b6b80d1520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:48.701216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c81c84-d473-4799-bfea-44b6b80d1520 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:48.701984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c81c84-d473-4799-bfea-44b6b80d1520 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:48.702258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c81c84-d473-4799-bfea-44b6b80d1520 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:48.702939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c81c84-d473-4799-bfea-44b6b80d1520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:48.703231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c81c84-d473-4799-bfea-44b6b80d1520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:48.704900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c81c84-d473-4799-bfea-44b6b80d1520 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:48.712251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:48.719273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1012/2004] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:06:48.723871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931a80e-83b6-4226-b492-102775ca86b9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:48.733529 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e931a80e-83b6-4226-b492-102775ca86b9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:48.738792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff2ddf-ca16-4f0d-86a9-6ff4df1e287c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:48.739486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff2ddf-ca16-4f0d-86a9-6ff4df1e287c admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:48.739764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff2ddf-ca16-4f0d-86a9-6ff4df1e287c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:48.740023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff2ddf-ca16-4f0d-86a9-6ff4df1e287c admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:48.740647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff2ddf-ca16-4f0d-86a9-6ff4df1e287c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:48.742592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beff2ddf-ca16-4f0d-86a9-6ff4df1e287c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:48.778672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 993/2005] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:48 2022] POST /identity/v3/projects => generated 367 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:48.780401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c81c84-d473-4799-bfea-44b6b80d1520 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:48.791205 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c81c84-d473-4799-bfea-44b6b80d1520 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:48.855855 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7346ccc-25d1-4478-bc5e-5a484e1b009a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:48.856450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346ccc-25d1-4478-bc5e-5a484e1b009a admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:48.856856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346ccc-25d1-4478-bc5e-5a484e1b009a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:48.857137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7346ccc-25d1-4478-bc5e-5a484e1b009a admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:48.857824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7346ccc-25d1-4478-bc5e-5a484e1b009a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:48.860771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7346ccc-25d1-4478-bc5e-5a484e1b009a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:48.885339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1013/2006] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:48 2022] POST /identity/v3/users => generated 284 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:48.894662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff2ddf-ca16-4f0d-86a9-6ff4df1e287c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:48.905908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff2ddf-ca16-4f0d-86a9-6ff4df1e287c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:48.910545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf624f-f4f5-4f9b-8856-b463d201c572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:48.911196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf624f-f4f5-4f9b-8856-b463d201c572 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:48.911467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf624f-f4f5-4f9b-8856-b463d201c572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:48.911916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cf624f-f4f5-4f9b-8856-b463d201c572 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:48.912560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf624f-f4f5-4f9b-8856-b463d201c572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:48.914155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cf624f-f4f5-4f9b-8856-b463d201c572 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:48.924773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 994/2007] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:48.929071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7346ccc-25d1-4478-bc5e-5a484e1b009a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:48.940120 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7346ccc-25d1-4478-bc5e-5a484e1b009a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:48.946036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762a451-c663-4c58-a060-e0de686ba532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:48.946650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762a451-c663-4c58-a060-e0de686ba532 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:48.946967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762a451-c663-4c58-a060-e0de686ba532 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:48.947901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762a451-c663-4c58-a060-e0de686ba532 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:48.948562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762a451-c663-4c58-a060-e0de686ba532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:48.950170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762a451-c663-4c58-a060-e0de686ba532 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:48.961595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1014/2008] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:48.966167 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf624f-f4f5-4f9b-8856-b463d201c572 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:48.976192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cf624f-f4f5-4f9b-8856-b463d201c572 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:48.981934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ba67a-7fb6-4d3d-8af5-b396f2524940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:48.982633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ba67a-7fb6-4d3d-8af5-b396f2524940 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:48.983073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ba67a-7fb6-4d3d-8af5-b396f2524940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:48.983345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395ba67a-7fb6-4d3d-8af5-b396f2524940 admin admin] PATH_INFO: `/v3/projects/0c706d1992854072bf20f45f119edfc8/users/b8a26d9a0a494c3cb4423049ef83e26d/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:49.000573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ba67a-7fb6-4d3d-8af5-b396f2524940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c706d1992854072bf20f45f119edfc8, user_id=b8a26d9a0a494c3cb4423049ef83e26d, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:49.003293 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395ba67a-7fb6-4d3d-8af5-b396f2524940 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:49.018273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 995/2009] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:48 2022] PUT /identity/v3/projects/0c706d1992854072bf20f45f119edfc8/users/b8a26d9a0a494c3cb4423049ef83e26d/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:49.030397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e7d7-7349-4638-b27c-8e805099f286 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:49.030923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e7d7-7349-4638-b27c-8e805099f286 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:49.031013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c5e7d7-7349-4638-b27c-8e805099f286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:49.062629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-51c5e7d7-7349-4638-b27c-8e805099f286 None None] MFA Rules not processed for user `b8a26d9a0a494c3cb4423049ef83e26d`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:49.064013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-51c5e7d7-7349-4638-b27c-8e805099f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:49.145954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1015/2010] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:49.157609 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ba67a-7fb6-4d3d-8af5-b396f2524940 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:49.159353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-395ba67a-7fb6-4d3d-8af5-b396f2524940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:49.218758 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395ba67a-7fb6-4d3d-8af5-b396f2524940 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:49.222629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c534907e-0201-4226-a931-21cc44dbf7ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7074acac73904bab8399f223bd662863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:49.223281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534907e-0201-4226-a931-21cc44dbf7ad service glance] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:49.223559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534907e-0201-4226-a931-21cc44dbf7ad service glance] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:49.223826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c534907e-0201-4226-a931-21cc44dbf7ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:49.233542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534907e-0201-4226-a931-21cc44dbf7ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:49.235304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c534907e-0201-4226-a931-21cc44dbf7ad service glance] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:49.249567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 996/2011] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:51.265341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e7d7-7349-4638-b27c-8e805099f286 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:51.266921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-51c5e7d7-7349-4638-b27c-8e805099f286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:51.340245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c5e7d7-7349-4638-b27c-8e805099f286 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:51.347129 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:51.348063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:51.348406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:51.348736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] PATH_INFO: `/v3/users/9f506692bc5e440788ed699494e052d6` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:51.350579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f506692bc5e440788ed699494e052d6)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:51.353495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:51.361103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:51.408490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f506692bc5e440788ed699494e052d6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:51.422743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f506692bc5e440788ed699494e052d6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:51.432461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f506692bc5e440788ed699494e052d6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:51.440283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f506692bc5e440788ed699494e052d6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:51.440973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f506692bc5e440788ed699494e052d6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:51.447325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1016/2012] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:51 2022] DELETE /identity/v3/users/9f506692bc5e440788ed699494e052d6 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:51.452918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5347-8418-4c9f-a307-05737bab2a17 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:51.453648 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5347-8418-4c9f-a307-05737bab2a17 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:51.453648 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599f5347-8418-4c9f-a307-05737bab2a17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:51.474416 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-599f5347-8418-4c9f-a307-05737bab2a17 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:51.475593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-599f5347-8418-4c9f-a307-05737bab2a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:51.486880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:51.542019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 997/2013] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:51.552098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:51.553603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:51.625354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b5a66-d3e3-4db1-b7ba-08bfa978f903 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:51.629580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c8d9b-9fc9-4e90-95f5-1c2fec6245d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:51.630200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8d9b-9fc9-4e90-95f5-1c2fec6245d9 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:51.630478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8d9b-9fc9-4e90-95f5-1c2fec6245d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:51.630897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925c8d9b-9fc9-4e90-95f5-1c2fec6245d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:51.642010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c8d9b-9fc9-4e90-95f5-1c2fec6245d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:51.643820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925c8d9b-9fc9-4e90-95f5-1c2fec6245d9 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:51.656142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1017/2014] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:51.969354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5347-8418-4c9f-a307-05737bab2a17 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:51.970903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-599f5347-8418-4c9f-a307-05737bab2a17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:51.984965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599f5347-8418-4c9f-a307-05737bab2a17 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:51.989836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:51.990420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:51.990702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:51.991013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] PATH_INFO: `/v3/projects/2de02f2706394e8692065b7a80aae7ed` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:51.992145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de02f2706394e8692065b7a80aae7ed)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:51.994361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:52.054980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de02f2706394e8692065b7a80aae7ed', 'request_id': 'req-151c7976-71c3-4b4e-a93f-725c3c22c2ca'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.064002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de02f2706394e8692065b7a80aae7ed', 'request_id': 'req-151c7976-71c3-4b4e-a93f-725c3c22c2ca'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.070373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de02f2706394e8692065b7a80aae7ed', 'request_id': 'req-151c7976-71c3-4b4e-a93f-725c3c22c2ca'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.081279 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] The token cache is being invalidate because project 2de02f2706394e8692065b7a80aae7ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:52.081567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.082192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.083734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 998/2015] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:51 2022] DELETE /identity/v3/projects/2de02f2706394e8692065b7a80aae7ed => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:52.087752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c8d9b-9fc9-4e90-95f5-1c2fec6245d9 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:52.098068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925c8d9b-9fc9-4e90-95f5-1c2fec6245d9 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:52.164839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:52.165726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:52.166191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:52.166536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] PATH_INFO: `/v3/users/04e9bb7fb71d4218b70723a959b975e7` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:52.168100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04e9bb7fb71d4218b70723a959b975e7)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:52.170161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:52.211804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:52.230104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04e9bb7fb71d4218b70723a959b975e7'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.244417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04e9bb7fb71d4218b70723a959b975e7'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.253675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04e9bb7fb71d4218b70723a959b975e7'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.265029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04e9bb7fb71d4218b70723a959b975e7'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.265898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c8679622-640e-44d7-a4ad-68dc33e29b00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04e9bb7fb71d4218b70723a959b975e7'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.273471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1018/2016] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:52 2022] DELETE /identity/v3/users/04e9bb7fb71d4218b70723a959b975e7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:52.574276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:52.575982 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:52.590272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151c7976-71c3-4b4e-a93f-725c3c22c2ca admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:52.655800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:52.656419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:52.656696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:52.656964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] PATH_INFO: `/v3/projects/c2594696293e412cbf9faaa2aa2c78a2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:52.658082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2594696293e412cbf9faaa2aa2c78a2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:52.660051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:52.712724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:52.720471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2594696293e412cbf9faaa2aa2c78a2', 'request_id': 'req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.729229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2594696293e412cbf9faaa2aa2c78a2', 'request_id': 'req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.735722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2594696293e412cbf9faaa2aa2c78a2', 'request_id': 'req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.746601 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] The token cache is being invalidate because project c2594696293e412cbf9faaa2aa2c78a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:52.746958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.747888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0e2cb0ee-adb0-48ca-a160-2c760ea3a3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:52.749752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 999/2017] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:52 2022] DELETE /identity/v3/projects/c2594696293e412cbf9faaa2aa2c78a2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:52.755432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b25a5a-63ee-46aa-887e-05252df7ec20 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:52.755716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b25a5a-63ee-46aa-887e-05252df7ec20 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:52.755991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b25a5a-63ee-46aa-887e-05252df7ec20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:52.781106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-12b25a5a-63ee-46aa-887e-05252df7ec20 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:52.782350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-12b25a5a-63ee-46aa-887e-05252df7ec20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:52.846659 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1019/2018] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:52.854801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14992-5d4d-476c-8fe8-7346e56bc649 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:52.855210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14992-5d4d-476c-8fe8-7346e56bc649 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:52.855484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a14992-5d4d-476c-8fe8-7346e56bc649 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:52.879916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-74a14992-5d4d-476c-8fe8-7346e56bc649 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:52.881180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-74a14992-5d4d-476c-8fe8-7346e56bc649 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:52.889739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1000/2019] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:52.894620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b25a5a-63ee-46aa-887e-05252df7ec20 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:52.904522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b25a5a-63ee-46aa-887e-05252df7ec20 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:52.911224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12ef23-ac86-460d-bf04-b92cd4405e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:52.912078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12ef23-ac86-460d-bf04-b92cd4405e59 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:52.912437 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12ef23-ac86-460d-bf04-b92cd4405e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:52.912778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b12ef23-ac86-460d-bf04-b92cd4405e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:52.913634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12ef23-ac86-460d-bf04-b92cd4405e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:52.914012 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12ef23-ac86-460d-bf04-b92cd4405e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:52.916513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b12ef23-ac86-460d-bf04-b92cd4405e59 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:52.931007 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1020/2020] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:06:52.936860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14992-5d4d-476c-8fe8-7346e56bc649 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:52.947911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a14992-5d4d-476c-8fe8-7346e56bc649 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:52.954527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f233d2-8b69-48f7-90a2-4b9a73fb59a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:52.955211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f233d2-8b69-48f7-90a2-4b9a73fb59a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:52.955470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f233d2-8b69-48f7-90a2-4b9a73fb59a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:52.955740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f233d2-8b69-48f7-90a2-4b9a73fb59a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:52.956386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f233d2-8b69-48f7-90a2-4b9a73fb59a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:52.958348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f233d2-8b69-48f7-90a2-4b9a73fb59a5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:52.992944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1001/2021] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:52 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:52.994115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12ef23-ac86-460d-bf04-b92cd4405e59 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.005566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b12ef23-ac86-460d-bf04-b92cd4405e59 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:53.076761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1cd97-a573-4633-b874-ef79bf4d7064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:53.077745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1cd97-a573-4633-b874-ef79bf4d7064 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.078044 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1cd97-a573-4633-b874-ef79bf4d7064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.078358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e1cd97-a573-4633-b874-ef79bf4d7064 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.079204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1cd97-a573-4633-b874-ef79bf4d7064 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:53.081558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e1cd97-a573-4633-b874-ef79bf4d7064 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:53.115652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1021/2022] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:52 2022] POST /identity/v3/users => generated 291 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:53.119636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f233d2-8b69-48f7-90a2-4b9a73fb59a5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.132686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f233d2-8b69-48f7-90a2-4b9a73fb59a5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:53.140030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a8fe0-f473-478f-8117-d27e9bd1025a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:53.141156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a8fe0-f473-478f-8117-d27e9bd1025a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.143059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a8fe0-f473-478f-8117-d27e9bd1025a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.143343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550a8fe0-f473-478f-8117-d27e9bd1025a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.144530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a8fe0-f473-478f-8117-d27e9bd1025a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:53.147085 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550a8fe0-f473-478f-8117-d27e9bd1025a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:53.169217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1002/2023] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:06:53.174009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1cd97-a573-4633-b874-ef79bf4d7064 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.184025 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e1cd97-a573-4633-b874-ef79bf4d7064 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:53.189156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca28c2d-5c66-40dd-835d-94c0cbf68da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:53.189767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28c2d-5c66-40dd-835d-94c0cbf68da6 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.190038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28c2d-5c66-40dd-835d-94c0cbf68da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.190306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca28c2d-5c66-40dd-835d-94c0cbf68da6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.191010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28c2d-5c66-40dd-835d-94c0cbf68da6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:53.192622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca28c2d-5c66-40dd-835d-94c0cbf68da6 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:53.203570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1022/2024] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:53.207867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a8fe0-f473-478f-8117-d27e9bd1025a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.219585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550a8fe0-f473-478f-8117-d27e9bd1025a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:53.225476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae570720-edbb-42ce-8dd8-49212bfa33fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:53.226154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae570720-edbb-42ce-8dd8-49212bfa33fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.226434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae570720-edbb-42ce-8dd8-49212bfa33fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.226727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae570720-edbb-42ce-8dd8-49212bfa33fc admin admin] PATH_INFO: `/v3/projects/1c5ad7374d0c459a98eff7ce1551f40e/users/d001b77de7304fe19c3374f41f1032d9/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.243322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae570720-edbb-42ce-8dd8-49212bfa33fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c5ad7374d0c459a98eff7ce1551f40e, user_id=d001b77de7304fe19c3374f41f1032d9, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:53.245995 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae570720-edbb-42ce-8dd8-49212bfa33fc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:53.260093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1003/2025] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:53 2022] PUT /identity/v3/projects/1c5ad7374d0c459a98eff7ce1551f40e/users/d001b77de7304fe19c3374f41f1032d9/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:53.271374 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df7ea-f4b5-49cd-a3d6-b4e0d347d50e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.271865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df7ea-f4b5-49cd-a3d6-b4e0d347d50e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.271965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3df7ea-f4b5-49cd-a3d6-b4e0d347d50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.299380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:53.302797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-8e3df7ea-f4b5-49cd-a3d6-b4e0d347d50e None None] MFA Rules not processed for user `d001b77de7304fe19c3374f41f1032d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:53.304819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8e3df7ea-f4b5-49cd-a3d6-b4e0d347d50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:53.373489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1023/2026] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:53.378856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae570720-edbb-42ce-8dd8-49212bfa33fc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.445740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae570720-edbb-42ce-8dd8-49212bfa33fc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:53.451149 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80038dc2-b709-47a3-acde-fb178c6a8f9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:53.451868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80038dc2-b709-47a3-acde-fb178c6a8f9e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.451868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80038dc2-b709-47a3-acde-fb178c6a8f9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.452826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80038dc2-b709-47a3-acde-fb178c6a8f9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.453526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80038dc2-b709-47a3-acde-fb178c6a8f9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:53.455786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80038dc2-b709-47a3-acde-fb178c6a8f9e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:53.494700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1004/2027] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:53 2022] POST /identity/v3/projects => generated 379 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:53.499123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3df7ea-f4b5-49cd-a3d6-b4e0d347d50e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.512336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3df7ea-f4b5-49cd-a3d6-b4e0d347d50e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:53.584367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80d9f5-de13-4640-a5a3-b79596163162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:53.584991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d9f5-de13-4640-a5a3-b79596163162 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.585261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d9f5-de13-4640-a5a3-b79596163162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.585537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80d9f5-de13-4640-a5a3-b79596163162 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.586165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80d9f5-de13-4640-a5a3-b79596163162 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:53.588173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80d9f5-de13-4640-a5a3-b79596163162 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:53.613621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1024/2028] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:53 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:53.615157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80038dc2-b709-47a3-acde-fb178c6a8f9e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.626015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80038dc2-b709-47a3-acde-fb178c6a8f9e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:53.630799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070035b-1c89-4a83-aa47-8ff7a85178d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:53.631458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070035b-1c89-4a83-aa47-8ff7a85178d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.631740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070035b-1c89-4a83-aa47-8ff7a85178d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.632014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070035b-1c89-4a83-aa47-8ff7a85178d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.632722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070035b-1c89-4a83-aa47-8ff7a85178d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:53.634408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070035b-1c89-4a83-aa47-8ff7a85178d7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:53.646202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1005/2029] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:53.650544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80d9f5-de13-4640-a5a3-b79596163162 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.662009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80d9f5-de13-4640-a5a3-b79596163162 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:53.668964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b72e-a796-4072-b7c6-65289e793bc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:53.669637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b72e-a796-4072-b7c6-65289e793bc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.669914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b72e-a796-4072-b7c6-65289e793bc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.670253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a9b72e-a796-4072-b7c6-65289e793bc4 admin admin] PATH_INFO: `/v3/projects/1614059702e440c58e25a60c3ec94a52/users/d363d1ed3c464c26a8e8b33f5ac792cd/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.686587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9b72e-a796-4072-b7c6-65289e793bc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614059702e440c58e25a60c3ec94a52, user_id=d363d1ed3c464c26a8e8b33f5ac792cd, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:53.689355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a9b72e-a796-4072-b7c6-65289e793bc4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:53.704945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1025/2030] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:53 2022] PUT /identity/v3/projects/1614059702e440c58e25a60c3ec94a52/users/d363d1ed3c464c26a8e8b33f5ac792cd/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:53.709206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070035b-1c89-4a83-aa47-8ff7a85178d7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.719798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070035b-1c89-4a83-aa47-8ff7a85178d7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:53.769122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:53.786838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9634ed73-b721-4f44-a7ea-bd13295c3f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:53.787425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ed73-b721-4f44-a7ea-bd13295c3f2a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.787719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ed73-b721-4f44-a7ea-bd13295c3f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.787986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9634ed73-b721-4f44-a7ea-bd13295c3f2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.788660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634ed73-b721-4f44-a7ea-bd13295c3f2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:53.790253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9634ed73-b721-4f44-a7ea-bd13295c3f2a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:53.800257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1006/2031] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:53 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:53.804663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b72e-a796-4072-b7c6-65289e793bc4 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.816998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a9b72e-a796-4072-b7c6-65289e793bc4 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:53.822016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb622-5777-447f-93ef-d3527882f304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:53.822682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb622-5777-447f-93ef-d3527882f304 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.823016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb622-5777-447f-93ef-d3527882f304 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.823290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dcb622-5777-447f-93ef-d3527882f304 admin admin] PATH_INFO: `/v3/projects/1614059702e440c58e25a60c3ec94a52/users/d363d1ed3c464c26a8e8b33f5ac792cd/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.825240 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcb622-5777-447f-93ef-d3527882f304 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1614059702e440c58e25a60c3ec94a52, user_id=d363d1ed3c464c26a8e8b33f5ac792cd, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:53.828642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dcb622-5777-447f-93ef-d3527882f304 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:53.840096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1026/2032] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:53 2022] PUT /identity/v3/projects/1614059702e440c58e25a60c3ec94a52/users/d363d1ed3c464c26a8e8b33f5ac792cd/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:53.853313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b28cf-1856-4266-82a6-32fada934b79 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:53.853598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b28cf-1856-4266-82a6-32fada934b79 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:53.853874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0b28cf-1856-4266-82a6-32fada934b79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:53.888212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9d0b28cf-1856-4266-82a6-32fada934b79 None None] MFA Rules not processed for user `d363d1ed3c464c26a8e8b33f5ac792cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:53.889499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9d0b28cf-1856-4266-82a6-32fada934b79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:53.965769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1007/2033] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:53.977570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb622-5777-447f-93ef-d3527882f304 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:53.979384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a8dcb622-5777-447f-93ef-d3527882f304 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:54.053311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dcb622-5777-447f-93ef-d3527882f304 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:54.057239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c28f00-62e7-4e90-a5b1-a3a8f038bf4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:54.057825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c28f00-62e7-4e90-a5b1-a3a8f038bf4b service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:54.058088 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c28f00-62e7-4e90-a5b1-a3a8f038bf4b service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:54.058358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c28f00-62e7-4e90-a5b1-a3a8f038bf4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:54.070331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c28f00-62e7-4e90-a5b1-a3a8f038bf4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:54.072221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c28f00-62e7-4e90-a5b1-a3a8f038bf4b service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:54.076879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:54.085678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1027/2034] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:53 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:54.588178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b28cf-1856-4266-82a6-32fada934b79 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:54.670676 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0b28cf-1856-4266-82a6-32fada934b79 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:54.676066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:54.676704 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:54.676978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:54.677248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] PATH_INFO: `/v3/users/d001b77de7304fe19c3374f41f1032d9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:54.678477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d001b77de7304fe19c3374f41f1032d9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:54.680494 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:54.735605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd001b77de7304fe19c3374f41f1032d9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:54.736280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd001b77de7304fe19c3374f41f1032d9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:54.736888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd001b77de7304fe19c3374f41f1032d9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:54.749773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:54.752432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd001b77de7304fe19c3374f41f1032d9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:54.766237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd001b77de7304fe19c3374f41f1032d9'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:54.783313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1008/2035] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:54 2022] DELETE /identity/v3/users/d001b77de7304fe19c3374f41f1032d9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:54.787875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a53892-4a12-48cc-ba22-fb33d671d1be None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:54.788394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a53892-4a12-48cc-ba22-fb33d671d1be None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:54.788394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a53892-4a12-48cc-ba22-fb33d671d1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:54.808311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-81a53892-4a12-48cc-ba22-fb33d671d1be None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:54.809527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-81a53892-4a12-48cc-ba22-fb33d671d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:54.870222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1028/2036] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:54.880384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:54.881861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:54.945460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2a38ee-3e09-4080-91e7-22377ec21500 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:54.949570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada76fa-65a0-4d25-a004-d83b3bf8e131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:54.950162 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada76fa-65a0-4d25-a004-d83b3bf8e131 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:54.950443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada76fa-65a0-4d25-a004-d83b3bf8e131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:54.950713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dada76fa-65a0-4d25-a004-d83b3bf8e131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:54.960396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada76fa-65a0-4d25-a004-d83b3bf8e131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:54.961855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dada76fa-65a0-4d25-a004-d83b3bf8e131 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:54.972975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1009/2037] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:55.271567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a53892-4a12-48cc-ba22-fb33d671d1be None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:55.273085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-81a53892-4a12-48cc-ba22-fb33d671d1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:55.291824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a53892-4a12-48cc-ba22-fb33d671d1be None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:55.298052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:55.298876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:55.299247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:55.299461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] PATH_INFO: `/v3/projects/1c5ad7374d0c459a98eff7ce1551f40e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:55.300597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c5ad7374d0c459a98eff7ce1551f40e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:55.302593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:55.354324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c5ad7374d0c459a98eff7ce1551f40e', 'request_id': 'req-2abb4d6a-574b-416d-b355-c2b2980b31c9'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:55.360303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c5ad7374d0c459a98eff7ce1551f40e', 'request_id': 'req-2abb4d6a-574b-416d-b355-c2b2980b31c9'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:55.368932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c5ad7374d0c459a98eff7ce1551f40e', 'request_id': 'req-2abb4d6a-574b-416d-b355-c2b2980b31c9'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:55.380779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] The token cache is being invalidate because project 1c5ad7374d0c459a98eff7ce1551f40e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:55.381066 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:55.381822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:55.383451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1029/2038] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:55 2022] DELETE /identity/v3/projects/1c5ad7374d0c459a98eff7ce1551f40e => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:55.389039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada76fa-65a0-4d25-a004-d83b3bf8e131 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:55.400563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dada76fa-65a0-4d25-a004-d83b3bf8e131 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:55.462557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:55.463461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:55.463798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:55.464071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] PATH_INFO: `/v3/users/d363d1ed3c464c26a8e8b33f5ac792cd` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:55.465267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d363d1ed3c464c26a8e8b33f5ac792cd)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:55.467426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:55.527454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd363d1ed3c464c26a8e8b33f5ac792cd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:55.528393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd363d1ed3c464c26a8e8b33f5ac792cd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:55.529191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd363d1ed3c464c26a8e8b33f5ac792cd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:55.542958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd363d1ed3c464c26a8e8b33f5ac792cd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:55.555298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0182b541-25f8-4614-b7b4-c77577291a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd363d1ed3c464c26a8e8b33f5ac792cd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:55.568280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1010/2039] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:55 2022] DELETE /identity/v3/users/d363d1ed3c464c26a8e8b33f5ac792cd => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:55.857721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:55.860017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:55.877023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb4d6a-574b-416d-b355-c2b2980b31c9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:55.950432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:55.951265 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:55.951777 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:55.952203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] PATH_INFO: `/v3/projects/1614059702e440c58e25a60c3ec94a52` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:55.953609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1614059702e440c58e25a60c3ec94a52)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:55.955643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:55.983870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:56.012122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1614059702e440c58e25a60c3ec94a52', 'request_id': 'req-865b195b-c963-426a-abab-b5d2c4532c51'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:56.019016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1614059702e440c58e25a60c3ec94a52', 'request_id': 'req-865b195b-c963-426a-abab-b5d2c4532c51'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:56.027977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1614059702e440c58e25a60c3ec94a52', 'request_id': 'req-865b195b-c963-426a-abab-b5d2c4532c51'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:56.039445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] The token cache is being invalidate because project 1614059702e440c58e25a60c3ec94a52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:06:56.039726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:56.040338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-865b195b-c963-426a-abab-b5d2c4532c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:56.041867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1030/2040] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:06:55 2022] DELETE /identity/v3/projects/1614059702e440c58e25a60c3ec94a52 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:06:56.047013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813bfbc-8087-41c1-a837-8d2cb2e1193d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:56.047489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813bfbc-8087-41c1-a837-8d2cb2e1193d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:56.047594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813bfbc-8087-41c1-a837-8d2cb2e1193d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:56.055790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:56.071127 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7813bfbc-8087-41c1-a837-8d2cb2e1193d None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:56.072353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7813bfbc-8087-41c1-a837-8d2cb2e1193d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:56.139645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1011/2041] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:56.147993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c6b51-cea9-4d3a-aa2a-e7feaf221322 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:56.148278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c6b51-cea9-4d3a-aa2a-e7feaf221322 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:56.148545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261c6b51-cea9-4d3a-aa2a-e7feaf221322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:56.170347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-261c6b51-cea9-4d3a-aa2a-e7feaf221322 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:56.171632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-261c6b51-cea9-4d3a-aa2a-e7feaf221322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:56.181149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1031/2042] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:56.186908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813bfbc-8087-41c1-a837-8d2cb2e1193d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:56.197189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813bfbc-8087-41c1-a837-8d2cb2e1193d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:56.203079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb1343-3124-4f33-8d97-4529ed01d5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:56.203688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb1343-3124-4f33-8d97-4529ed01d5f3 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:56.203965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb1343-3124-4f33-8d97-4529ed01d5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:56.204229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fb1343-3124-4f33-8d97-4529ed01d5f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:56.204877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb1343-3124-4f33-8d97-4529ed01d5f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:06:56.205165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb1343-3124-4f33-8d97-4529ed01d5f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:56.207015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fb1343-3124-4f33-8d97-4529ed01d5f3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:56.223773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1012/2043] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:06:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:06:56.224922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c6b51-cea9-4d3a-aa2a-e7feaf221322 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:56.235419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261c6b51-cea9-4d3a-aa2a-e7feaf221322 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:56.241319 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2ad3f-763d-4186-b198-53b16016f9d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:56.241984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2ad3f-763d-4186-b198-53b16016f9d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:56.242262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2ad3f-763d-4186-b198-53b16016f9d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:56.242532 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d2ad3f-763d-4186-b198-53b16016f9d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:56.243250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2ad3f-763d-4186-b198-53b16016f9d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:56.245214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d2ad3f-763d-4186-b198-53b16016f9d8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:56.278164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1032/2044] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:06:56 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:06:56.281776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb1343-3124-4f33-8d97-4529ed01d5f3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:56.292080 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fb1343-3124-4f33-8d97-4529ed01d5f3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:56.360299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990cfe0-7704-493d-83fa-34212cb65862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:56.360876 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990cfe0-7704-493d-83fa-34212cb65862 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:56.361148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990cfe0-7704-493d-83fa-34212cb65862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:56.361418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8990cfe0-7704-493d-83fa-34212cb65862 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:56.362035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990cfe0-7704-493d-83fa-34212cb65862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:56.364101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8990cfe0-7704-493d-83fa-34212cb65862 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:56.386509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1013/2045] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:06:56 2022] POST /identity/v3/users => generated 292 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:06:56.391257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2ad3f-763d-4186-b198-53b16016f9d8 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:56.402052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d2ad3f-763d-4186-b198-53b16016f9d8 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:56.407201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813e7f1-002c-48db-9fac-82020ff8f354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:56.407799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813e7f1-002c-48db-9fac-82020ff8f354 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:56.408075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813e7f1-002c-48db-9fac-82020ff8f354 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:56.408344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f813e7f1-002c-48db-9fac-82020ff8f354 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:56.408983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813e7f1-002c-48db-9fac-82020ff8f354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:56.410724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f813e7f1-002c-48db-9fac-82020ff8f354 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:56.422178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1033/2046] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:56.426387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990cfe0-7704-493d-83fa-34212cb65862 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:56.444650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8990cfe0-7704-493d-83fa-34212cb65862 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:56.451586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e7ba61-4d83-44c0-a918-d71b2988600b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:56.452621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ba61-4d83-44c0-a918-d71b2988600b admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:56.453113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ba61-4d83-44c0-a918-d71b2988600b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:56.453387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e7ba61-4d83-44c0-a918-d71b2988600b admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:56.454057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7ba61-4d83-44c0-a918-d71b2988600b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:56.456840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e7ba61-4d83-44c0-a918-d71b2988600b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:56.475214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1014/2047] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:06:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:06:56.479764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813e7f1-002c-48db-9fac-82020ff8f354 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:56.496336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f813e7f1-002c-48db-9fac-82020ff8f354 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:56.505639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce983f-6a09-4b16-a8f8-78cb5afaa1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:56.507555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce983f-6a09-4b16-a8f8-78cb5afaa1c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:56.507932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce983f-6a09-4b16-a8f8-78cb5afaa1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:56.508308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce983f-6a09-4b16-a8f8-78cb5afaa1c7 admin admin] PATH_INFO: `/v3/projects/0f9fc923737743f2a7b5291b0d6d9f85/users/350196ba1d8d45f08ec10cd35145447e/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:56.542612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce983f-6a09-4b16-a8f8-78cb5afaa1c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f9fc923737743f2a7b5291b0d6d9f85, user_id=350196ba1d8d45f08ec10cd35145447e, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:56.550913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ce983f-6a09-4b16-a8f8-78cb5afaa1c7 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:56.573054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1034/2048] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:06:56 2022] PUT /identity/v3/projects/0f9fc923737743f2a7b5291b0d6d9f85/users/350196ba1d8d45f08ec10cd35145447e/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:56.588946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5c43-1be2-4676-a24f-4046af7e8ed2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:56.589232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5c43-1be2-4676-a24f-4046af7e8ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:56.589502 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09f5c43-1be2-4676-a24f-4046af7e8ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:56.629663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c09f5c43-1be2-4676-a24f-4046af7e8ed2 None None] MFA Rules not processed for user `350196ba1d8d45f08ec10cd35145447e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:56.631410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c09f5c43-1be2-4676-a24f-4046af7e8ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:56.707285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:56.713868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1015/2049] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:06:56.726676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce983f-6a09-4b16-a8f8-78cb5afaa1c7 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:56.728737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-60ce983f-6a09-4b16-a8f8-78cb5afaa1c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:56.789161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ce983f-6a09-4b16-a8f8-78cb5afaa1c7 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:56.793519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4cc750-d021-48ff-8624-e113a9199782 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:56.794137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cc750-d021-48ff-8624-e113a9199782 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:56.794410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cc750-d021-48ff-8624-e113a9199782 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:56.794678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4cc750-d021-48ff-8624-e113a9199782 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:56.803988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cc750-d021-48ff-8624-e113a9199782 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:56.805445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4cc750-d021-48ff-8624-e113a9199782 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:56.814660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1035/2050] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:06:59.431882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f5c43-1be2-4676-a24f-4046af7e8ed2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:59.527998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09f5c43-1be2-4676-a24f-4046af7e8ed2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:59.534015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:59.534661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:59.535512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:59.535803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] PATH_INFO: `/v3/users/350196ba1d8d45f08ec10cd35145447e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:59.536973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=350196ba1d8d45f08ec10cd35145447e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:59.539050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:59.594291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350196ba1d8d45f08ec10cd35145447e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:59.595007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350196ba1d8d45f08ec10cd35145447e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:59.595636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350196ba1d8d45f08ec10cd35145447e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:59.607797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350196ba1d8d45f08ec10cd35145447e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:59.617280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350196ba1d8d45f08ec10cd35145447e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:06:59.630537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1016/2051] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:06:59 2022] DELETE /identity/v3/users/350196ba1d8d45f08ec10cd35145447e => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:06:59.635320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc8540-2eea-44a9-a304-43d861022572 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:59.635811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc8540-2eea-44a9-a304-43d861022572 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:59.635928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bc8540-2eea-44a9-a304-43d861022572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:59.656966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-b1bc8540-2eea-44a9-a304-43d861022572 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:06:59.658230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b1bc8540-2eea-44a9-a304-43d861022572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:59.706462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:06:59.725888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1036/2052] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:06:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:06:59.736304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:06:59.738080 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:06:59.798637 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77f50a-623a-48cd-93e4-84b3511e2297 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:06:59.802378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8123f170-31a2-4445-9044-a17cc09b89cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:06:59.803044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123f170-31a2-4445-9044-a17cc09b89cc service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:06:59.803313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123f170-31a2-4445-9044-a17cc09b89cc service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:06:59.803590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8123f170-31a2-4445-9044-a17cc09b89cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:06:59.814501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123f170-31a2-4445-9044-a17cc09b89cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:06:59.816020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8123f170-31a2-4445-9044-a17cc09b89cc service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:06:59.825601 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1017/2053] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:06:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:00.179982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc8540-2eea-44a9-a304-43d861022572 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:00.181779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b1bc8540-2eea-44a9-a304-43d861022572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:00.196095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bc8540-2eea-44a9-a304-43d861022572 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:00.202190 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:00.202918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.203194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.203513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] PATH_INFO: `/v3/projects/0f9fc923737743f2a7b5291b0d6d9f85` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.204748 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f9fc923737743f2a7b5291b0d6d9f85)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:00.206658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:00.257355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f9fc923737743f2a7b5291b0d6d9f85', 'request_id': 'req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:00.263021 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f9fc923737743f2a7b5291b0d6d9f85', 'request_id': 'req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:00.271989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f9fc923737743f2a7b5291b0d6d9f85', 'request_id': 'req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:00.288170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] The token cache is being invalidate because project 0f9fc923737743f2a7b5291b0d6d9f85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:07:00.288440 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:00.289143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f67e37c-8b49-4bcb-9a56-b42ce602c5d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:00.290696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1037/2054] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:07:00 2022] DELETE /identity/v3/projects/0f9fc923737743f2a7b5291b0d6d9f85 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:00.295981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671032-d279-4c5e-88c8-56633e5874f9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.296334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671032-d279-4c5e-88c8-56633e5874f9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.296698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e671032-d279-4c5e-88c8-56633e5874f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.317694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6e671032-d279-4c5e-88c8-56633e5874f9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:00.319003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6e671032-d279-4c5e-88c8-56633e5874f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:00.334249 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:00.388163 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1018/2055] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:00.396893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77795c-fe12-4955-8f75-d3e7423e3a75 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.397284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77795c-fe12-4955-8f75-d3e7423e3a75 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.397572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b77795c-fe12-4955-8f75-d3e7423e3a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.419526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-6b77795c-fe12-4955-8f75-d3e7423e3a75 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:00.421232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6b77795c-fe12-4955-8f75-d3e7423e3a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:00.432221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1038/2056] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:00.437718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e671032-d279-4c5e-88c8-56633e5874f9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:00.453166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e671032-d279-4c5e-88c8-56633e5874f9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:00.459626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bd775-5bd2-426a-b005-a8105174bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:00.460231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd775-5bd2-426a-b005-a8105174bb41 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.460520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd775-5bd2-426a-b005-a8105174bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.460788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167bd775-5bd2-426a-b005-a8105174bb41 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.461444 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bd775-5bd2-426a-b005-a8105174bb41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:07:00.461749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bd775-5bd2-426a-b005-a8105174bb41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:00.463432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167bd775-5bd2-426a-b005-a8105174bb41 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:00.476405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1019/2057] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:07:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:07:00.481525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77795c-fe12-4955-8f75-d3e7423e3a75 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:00.492079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b77795c-fe12-4955-8f75-d3e7423e3a75 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:00.497484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c750c-1e9d-4dd7-9a6a-c37882fe398c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:00.498091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c750c-1e9d-4dd7-9a6a-c37882fe398c admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.498450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c750c-1e9d-4dd7-9a6a-c37882fe398c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.498726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1c750c-1e9d-4dd7-9a6a-c37882fe398c admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.499596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c750c-1e9d-4dd7-9a6a-c37882fe398c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:00.501530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1c750c-1e9d-4dd7-9a6a-c37882fe398c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:00.531466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1039/2058] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:00 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:00.535881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bd775-5bd2-426a-b005-a8105174bb41 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:00.547588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167bd775-5bd2-426a-b005-a8105174bb41 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:00.621165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9b06-8284-4d2f-9b8c-7c8f44e35b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:00.621777 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9b06-8284-4d2f-9b8c-7c8f44e35b2e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.622057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9b06-8284-4d2f-9b8c-7c8f44e35b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.622332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175d9b06-8284-4d2f-9b8c-7c8f44e35b2e admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.623007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9b06-8284-4d2f-9b8c-7c8f44e35b2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:00.625381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-175d9b06-8284-4d2f-9b8c-7c8f44e35b2e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:00.653017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1020/2059] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:00 2022] POST /identity/v3/users => generated 291 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:07:00.654572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c750c-1e9d-4dd7-9a6a-c37882fe398c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:00.666795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1c750c-1e9d-4dd7-9a6a-c37882fe398c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:00.672615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd1186-e9a1-490e-ba79-0a77e1ea0c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:00.673232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd1186-e9a1-490e-ba79-0a77e1ea0c2f admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.673511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd1186-e9a1-490e-ba79-0a77e1ea0c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.673781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9abd1186-e9a1-490e-ba79-0a77e1ea0c2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.674435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd1186-e9a1-490e-ba79-0a77e1ea0c2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:00.676096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9abd1186-e9a1-490e-ba79-0a77e1ea0c2f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:00.687814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1040/2060] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:00.692045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9b06-8284-4d2f-9b8c-7c8f44e35b2e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:00.703509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175d9b06-8284-4d2f-9b8c-7c8f44e35b2e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:00.712425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6ee86c-9c76-4264-aa48-203bde5c9ca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:00.715000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee86c-9c76-4264-aa48-203bde5c9ca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.715283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee86c-9c76-4264-aa48-203bde5c9ca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.715555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6ee86c-9c76-4264-aa48-203bde5c9ca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.716243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ee86c-9c76-4264-aa48-203bde5c9ca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:00.718603 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6ee86c-9c76-4264-aa48-203bde5c9ca3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:00.732938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1021/2061] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:00.738755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd1186-e9a1-490e-ba79-0a77e1ea0c2f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:00.752630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9abd1186-e9a1-490e-ba79-0a77e1ea0c2f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:00.762486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fce86-e6c4-4fc4-a58a-e2c94c93c28d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:00.763218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fce86-e6c4-4fc4-a58a-e2c94c93c28d admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.763501 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fce86-e6c4-4fc4-a58a-e2c94c93c28d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.763775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74fce86-e6c4-4fc4-a58a-e2c94c93c28d admin admin] PATH_INFO: `/v3/projects/4934527a57f049cfa123e8b33180f4f6/users/c484e6ecc6af477e851979a130a69cfc/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.783350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fce86-e6c4-4fc4-a58a-e2c94c93c28d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4934527a57f049cfa123e8b33180f4f6, user_id=c484e6ecc6af477e851979a130a69cfc, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:00.786448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74fce86-e6c4-4fc4-a58a-e2c94c93c28d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:00.801215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1041/2062] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:00 2022] PUT /identity/v3/projects/4934527a57f049cfa123e8b33180f4f6/users/c484e6ecc6af477e851979a130a69cfc/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:00.806430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc832f-ecba-4ad7-b3be-890281577fc1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.806718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc832f-ecba-4ad7-b3be-890281577fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.807026 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc832f-ecba-4ad7-b3be-890281577fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.825727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-29bc832f-ecba-4ad7-b3be-890281577fc1 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:00.827044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-29bc832f-ecba-4ad7-b3be-890281577fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:00.891807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1022/2063] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:00.903269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fce86-e6c4-4fc4-a58a-e2c94c93c28d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:00.906327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e74fce86-e6c4-4fc4-a58a-e2c94c93c28d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:00.972015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74fce86-e6c4-4fc4-a58a-e2c94c93c28d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:00.976275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2ca7a-28b9-4b67-8842-e6941647e038 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:00.976856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2ca7a-28b9-4b67-8842-e6941647e038 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:00.977135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2ca7a-28b9-4b67-8842-e6941647e038 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:00.977410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e2ca7a-28b9-4b67-8842-e6941647e038 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:00.988764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2ca7a-28b9-4b67-8842-e6941647e038 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:00.990233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e2ca7a-28b9-4b67-8842-e6941647e038 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:01.000598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1042/2064] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:01.704072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d30c18-45bb-4855-8485-46e37f24d115 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:01.704538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d30c18-45bb-4855-8485-46e37f24d115 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:01.704803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d30c18-45bb-4855-8485-46e37f24d115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:01.738001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b3d30c18-45bb-4855-8485-46e37f24d115 None None] MFA Rules not processed for user `c484e6ecc6af477e851979a130a69cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:01.739308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b3d30c18-45bb-4855-8485-46e37f24d115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:01.763284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:01.850816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1023/2065] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:01 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:01.862727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2ca7a-28b9-4b67-8842-e6941647e038 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:01.864254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-63e2ca7a-28b9-4b67-8842-e6941647e038 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:01.884062 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:01.937729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e2ca7a-28b9-4b67-8842-e6941647e038 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:01.944612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d718f92-8ef7-408f-bc35-07b3d2366407 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:01.945410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d718f92-8ef7-408f-bc35-07b3d2366407 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:01.945758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d718f92-8ef7-408f-bc35-07b3d2366407 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:01.946095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d718f92-8ef7-408f-bc35-07b3d2366407 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:01.956149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d718f92-8ef7-408f-bc35-07b3d2366407 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:01.957673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d718f92-8ef7-408f-bc35-07b3d2366407 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:01.988050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1043/2066] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:01 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:03.487528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8823f-158a-4055-9023-da096e8589e6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:03.488150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8823f-158a-4055-9023-da096e8589e6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:03.488150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda8823f-158a-4055-9023-da096e8589e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:03.511016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dda8823f-158a-4055-9023-da096e8589e6 None None] MFA Rules not processed for user `c484e6ecc6af477e851979a130a69cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:03.511016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dda8823f-158a-4055-9023-da096e8589e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:03.518014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1024/2067] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:09.551051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d718f92-8ef7-408f-bc35-07b3d2366407 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:09.554425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-9d718f92-8ef7-408f-bc35-07b3d2366407 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:09.570754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d718f92-8ef7-408f-bc35-07b3d2366407 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:09.575513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:09.576147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:09.576545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:09.576936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] PATH_INFO: `/v3/users/d7514587fb914c48990104851fa8bad0` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:09.578338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7514587fb914c48990104851fa8bad0)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:09.580364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:09.642866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7514587fb914c48990104851fa8bad0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:09.657064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7514587fb914c48990104851fa8bad0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:09.666699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7514587fb914c48990104851fa8bad0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:09.678092 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7514587fb914c48990104851fa8bad0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:09.679228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4d4978c9-b64d-4fce-be28-d223558832a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7514587fb914c48990104851fa8bad0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:09.688250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1044/2068] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:07:09 2022] DELETE /identity/v3/users/d7514587fb914c48990104851fa8bad0 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:09.880421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8823f-158a-4055-9023-da096e8589e6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:09.911176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda8823f-158a-4055-9023-da096e8589e6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:09.970926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:09.971570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:09.971892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:09.972161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] PATH_INFO: `/v3/projects/2270d0529ef1465291051b14fbc2dae6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:09.973286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2270d0529ef1465291051b14fbc2dae6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:09.975432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:10.025506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2270d0529ef1465291051b14fbc2dae6', 'request_id': 'req-5d6371f8-14e2-47ce-802a-4e9d2adeca49'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:10.035224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2270d0529ef1465291051b14fbc2dae6', 'request_id': 'req-5d6371f8-14e2-47ce-802a-4e9d2adeca49'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:10.041647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2270d0529ef1465291051b14fbc2dae6', 'request_id': 'req-5d6371f8-14e2-47ce-802a-4e9d2adeca49'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:10.052328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] The token cache is being invalidate because project 2270d0529ef1465291051b14fbc2dae6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:07:10.052615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:10.053286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5d6371f8-14e2-47ce-802a-4e9d2adeca49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:10.054824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1025/2069] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:07:09 2022] DELETE /identity/v3/projects/2270d0529ef1465291051b14fbc2dae6 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:10.059794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e118e-2f76-4007-a6b9-1a99cccfba2e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.060099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e118e-2f76-4007-a6b9-1a99cccfba2e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.060368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8e118e-2f76-4007-a6b9-1a99cccfba2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.079988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ab8e118e-2f76-4007-a6b9-1a99cccfba2e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:10.081224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ab8e118e-2f76-4007-a6b9-1a99cccfba2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:10.150896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1045/2070] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:10.152483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339dc85-0b6e-4170-a5a2-7196a81d2927 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.152764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339dc85-0b6e-4170-a5a2-7196a81d2927 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.153036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6339dc85-0b6e-4170-a5a2-7196a81d2927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.178246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6339dc85-0b6e-4170-a5a2-7196a81d2927 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:10.179751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6339dc85-0b6e-4170-a5a2-7196a81d2927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:10.188978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1026/2071] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:10.193502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e118e-2f76-4007-a6b9-1a99cccfba2e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:10.203828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8e118e-2f76-4007-a6b9-1a99cccfba2e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:10.209019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7162a-a874-43bd-8b60-9d9d54075215 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:10.209626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7162a-a874-43bd-8b60-9d9d54075215 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.209903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7162a-a874-43bd-8b60-9d9d54075215 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.210172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b7162a-a874-43bd-8b60-9d9d54075215 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.210874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7162a-a874-43bd-8b60-9d9d54075215 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:07:10.211170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7162a-a874-43bd-8b60-9d9d54075215 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:10.212853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b7162a-a874-43bd-8b60-9d9d54075215 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:10.225525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1046/2072] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:07:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:07:10.230268 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339dc85-0b6e-4170-a5a2-7196a81d2927 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:10.240737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6339dc85-0b6e-4170-a5a2-7196a81d2927 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:10.245774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daba70-2311-406b-8853-511702148acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:10.246332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daba70-2311-406b-8853-511702148acd admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.246608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daba70-2311-406b-8853-511702148acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.246992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62daba70-2311-406b-8853-511702148acd admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.247614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daba70-2311-406b-8853-511702148acd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:10.249622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62daba70-2311-406b-8853-511702148acd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:10.282872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1027/2073] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:10 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:07:10.287239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7162a-a874-43bd-8b60-9d9d54075215 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:10.298195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b7162a-a874-43bd-8b60-9d9d54075215 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:10.310719 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:10.359953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc07e6c-c302-4cbb-9c8d-a080de862423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:10.360571 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07e6c-c302-4cbb-9c8d-a080de862423 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.360849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07e6c-c302-4cbb-9c8d-a080de862423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.361117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc07e6c-c302-4cbb-9c8d-a080de862423 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.361770 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc07e6c-c302-4cbb-9c8d-a080de862423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:10.363852 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc07e6c-c302-4cbb-9c8d-a080de862423 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:10.391558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1047/2074] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:10 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:07:10.392771 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daba70-2311-406b-8853-511702148acd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:10.404059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62daba70-2311-406b-8853-511702148acd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:10.410024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57205b71-7599-4778-9db3-94e337a0c11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:10.410661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57205b71-7599-4778-9db3-94e337a0c11d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.410976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57205b71-7599-4778-9db3-94e337a0c11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.411254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57205b71-7599-4778-9db3-94e337a0c11d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.411925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57205b71-7599-4778-9db3-94e337a0c11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:10.413612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57205b71-7599-4778-9db3-94e337a0c11d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:10.419555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:10.426761 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1028/2075] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:10.430259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc07e6c-c302-4cbb-9c8d-a080de862423 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:10.440979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc07e6c-c302-4cbb-9c8d-a080de862423 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:10.446290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca39ddc0-9d67-42f9-a1d7-fa61cc4b0ebe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:10.446974 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39ddc0-9d67-42f9-a1d7-fa61cc4b0ebe admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.447259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39ddc0-9d67-42f9-a1d7-fa61cc4b0ebe admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.447558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca39ddc0-9d67-42f9-a1d7-fa61cc4b0ebe admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.448237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39ddc0-9d67-42f9-a1d7-fa61cc4b0ebe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:10.449888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca39ddc0-9d67-42f9-a1d7-fa61cc4b0ebe admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:10.466722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1048/2076] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:10.468498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57205b71-7599-4778-9db3-94e337a0c11d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:10.481663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57205b71-7599-4778-9db3-94e337a0c11d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:10.488148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628811ab-4773-44c5-a431-9ea22bd9653c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:10.488869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628811ab-4773-44c5-a431-9ea22bd9653c admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.489150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628811ab-4773-44c5-a431-9ea22bd9653c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.489423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628811ab-4773-44c5-a431-9ea22bd9653c admin admin] PATH_INFO: `/v3/projects/c8499e639cc142cf8e413460ca3d7adf/users/4774b2f6020b434595c578a738caccde/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.505786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628811ab-4773-44c5-a431-9ea22bd9653c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8499e639cc142cf8e413460ca3d7adf, user_id=4774b2f6020b434595c578a738caccde, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:10.508422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-628811ab-4773-44c5-a431-9ea22bd9653c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:10.523400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1029/2077] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:10 2022] PUT /identity/v3/projects/c8499e639cc142cf8e413460ca3d7adf/users/4774b2f6020b434595c578a738caccde/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:10.528668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d182c1a-1505-426e-b891-f7bbba8fce27 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.528952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d182c1a-1505-426e-b891-f7bbba8fce27 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.529220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d182c1a-1505-426e-b891-f7bbba8fce27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.552718 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-8d182c1a-1505-426e-b891-f7bbba8fce27 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:10.553949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8d182c1a-1505-426e-b891-f7bbba8fce27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:10.614734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1049/2078] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:10.624714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628811ab-4773-44c5-a431-9ea22bd9653c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:10.627471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-628811ab-4773-44c5-a431-9ea22bd9653c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:10.695068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628811ab-4773-44c5-a431-9ea22bd9653c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:10.699027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297b953-cc38-4954-b975-3e19cbeff8aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:10.699638 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297b953-cc38-4954-b975-3e19cbeff8aa service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:10.699916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297b953-cc38-4954-b975-3e19cbeff8aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:10.700186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297b953-cc38-4954-b975-3e19cbeff8aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:10.714695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297b953-cc38-4954-b975-3e19cbeff8aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:10.716914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297b953-cc38-4954-b975-3e19cbeff8aa service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:10.732075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1030/2079] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:15.720284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2ad40-8e00-4248-9302-b6a7044e5632 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:15.720759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2ad40-8e00-4248-9302-b6a7044e5632 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:15.720840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2ad40-8e00-4248-9302-b6a7044e5632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:15.796785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-34c2ad40-8e00-4248-9302-b6a7044e5632 None None] MFA Rules not processed for user `4774b2f6020b434595c578a738caccde`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:15.798162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-34c2ad40-8e00-4248-9302-b6a7044e5632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:15.902181 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1050/2080] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:15 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:15.916757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297b953-cc38-4954-b975-3e19cbeff8aa service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:15.919465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6297b953-cc38-4954-b975-3e19cbeff8aa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:16.025978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297b953-cc38-4954-b975-3e19cbeff8aa service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:16.038937 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998dc93-04b7-43d8-9457-020c874a5c3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:16.039576 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998dc93-04b7-43d8-9457-020c874a5c3d service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:16.039856 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998dc93-04b7-43d8-9457-020c874a5c3d service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:16.040130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1998dc93-04b7-43d8-9457-020c874a5c3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:16.048905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998dc93-04b7-43d8-9457-020c874a5c3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:16.050540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1998dc93-04b7-43d8-9457-020c874a5c3d service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:16.060408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1031/2081] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:15 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:17.669900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cded1-1824-44a9-ae4e-12f074563bcd None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:17.670429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cded1-1824-44a9-ae4e-12f074563bcd None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:17.670508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686cded1-1824-44a9-ae4e-12f074563bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:17.707300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-686cded1-1824-44a9-ae4e-12f074563bcd None None] MFA Rules not processed for user `4774b2f6020b434595c578a738caccde`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:17.709089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-686cded1-1824-44a9-ae4e-12f074563bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:17.719745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1051/2082] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:17 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:20.396679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998dc93-04b7-43d8-9457-020c874a5c3d service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:20.408178 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1998dc93-04b7-43d8-9457-020c874a5c3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:20.426333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1998dc93-04b7-43d8-9457-020c874a5c3d service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:20.431377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:20.432213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:20.432669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:20.433192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] PATH_INFO: `/v3/users/3006c5237b574c6db99e12aa6b454e92` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:20.437329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3006c5237b574c6db99e12aa6b454e92)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:20.440083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:20.505515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3006c5237b574c6db99e12aa6b454e92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:20.506318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3006c5237b574c6db99e12aa6b454e92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:20.507006 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3006c5237b574c6db99e12aa6b454e92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:20.519046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:20.528196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3006c5237b574c6db99e12aa6b454e92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:20.536936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3006c5237b574c6db99e12aa6b454e92'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:20.551105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1032/2083] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:07:20 2022] DELETE /identity/v3/users/3006c5237b574c6db99e12aa6b454e92 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:20.555821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c35c3e-53cd-4c0c-9d80-dfb38a198aed None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:20.556270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c35c3e-53cd-4c0c-9d80-dfb38a198aed None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:20.556441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c35c3e-53cd-4c0c-9d80-dfb38a198aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:20.575491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-25c35c3e-53cd-4c0c-9d80-dfb38a198aed None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:20.576703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-25c35c3e-53cd-4c0c-9d80-dfb38a198aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:20.599913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:20.655136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1052/2084] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:20.666412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:20.668015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:20.742509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf09d6b-218a-456f-b01a-90dd17b8d04b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:20.746626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be78b718-3ddd-47ca-920f-33c3cba1c9d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:20.747735 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78b718-3ddd-47ca-920f-33c3cba1c9d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:20.748078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78b718-3ddd-47ca-920f-33c3cba1c9d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:20.748417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be78b718-3ddd-47ca-920f-33c3cba1c9d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:20.766222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78b718-3ddd-47ca-920f-33c3cba1c9d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:20.768154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be78b718-3ddd-47ca-920f-33c3cba1c9d3 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:20.779283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1033/2085] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:21.085390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c35c3e-53cd-4c0c-9d80-dfb38a198aed None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:21.086873 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-25c35c3e-53cd-4c0c-9d80-dfb38a198aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:21.099049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c35c3e-53cd-4c0c-9d80-dfb38a198aed None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:21.104243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:21.105009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.105284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.105549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] PATH_INFO: `/v3/projects/47f0bc6b88194167a49440c428dc99cb` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.106683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47f0bc6b88194167a49440c428dc99cb)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:21.108630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:21.160581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47f0bc6b88194167a49440c428dc99cb', 'request_id': 'req-bc962750-b3de-4d70-a821-c1c0c11f9422'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:21.166510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47f0bc6b88194167a49440c428dc99cb', 'request_id': 'req-bc962750-b3de-4d70-a821-c1c0c11f9422'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:21.175738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47f0bc6b88194167a49440c428dc99cb', 'request_id': 'req-bc962750-b3de-4d70-a821-c1c0c11f9422'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:21.188502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] The token cache is being invalidate because project 47f0bc6b88194167a49440c428dc99cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:07:21.188810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:21.189676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-bc962750-b3de-4d70-a821-c1c0c11f9422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:21.191261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1053/2086] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:07:21 2022] DELETE /identity/v3/projects/47f0bc6b88194167a49440c428dc99cb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:21.196281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db1233-473a-4056-b59a-18d260e25492 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.196566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db1233-473a-4056-b59a-18d260e25492 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.196840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95db1233-473a-4056-b59a-18d260e25492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.216342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-95db1233-473a-4056-b59a-18d260e25492 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:21.217529 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-95db1233-473a-4056-b59a-18d260e25492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:21.289275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1034/2087] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:21.297138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c32ee-9b9d-4f58-9323-3c522660a5a2 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.297421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c32ee-9b9d-4f58-9323-3c522660a5a2 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.297722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c32ee-9b9d-4f58-9323-3c522660a5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.322819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-659c32ee-9b9d-4f58-9323-3c522660a5a2 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:21.322819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-659c32ee-9b9d-4f58-9323-3c522660a5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:21.330757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1054/2088] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:21.335351 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db1233-473a-4056-b59a-18d260e25492 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:21.346014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95db1233-473a-4056-b59a-18d260e25492 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:21.351782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ceb8a-fcf5-4723-82f5-ca21fd90cc50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:21.352383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ceb8a-fcf5-4723-82f5-ca21fd90cc50 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.352661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ceb8a-fcf5-4723-82f5-ca21fd90cc50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.352936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ceb8a-fcf5-4723-82f5-ca21fd90cc50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.353579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ceb8a-fcf5-4723-82f5-ca21fd90cc50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:07:21.353884 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ceb8a-fcf5-4723-82f5-ca21fd90cc50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:21.355700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ceb8a-fcf5-4723-82f5-ca21fd90cc50 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:21.368270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1035/2089] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:07:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:07:21.372879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c32ee-9b9d-4f58-9323-3c522660a5a2 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:21.385608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c32ee-9b9d-4f58-9323-3c522660a5a2 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:21.391457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390b138-a76a-49a7-b392-523a3387eb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:21.392207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390b138-a76a-49a7-b392-523a3387eb25 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.392588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390b138-a76a-49a7-b392-523a3387eb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.392948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7390b138-a76a-49a7-b392-523a3387eb25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.394000 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390b138-a76a-49a7-b392-523a3387eb25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:21.396064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7390b138-a76a-49a7-b392-523a3387eb25 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:21.426115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1055/2090] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:21 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:21.430921 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ceb8a-fcf5-4723-82f5-ca21fd90cc50 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:21.445830 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ceb8a-fcf5-4723-82f5-ca21fd90cc50 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:21.508458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73800a-3bba-46e2-931f-b0faecc616b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:21.509063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73800a-3bba-46e2-931f-b0faecc616b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.509346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73800a-3bba-46e2-931f-b0faecc616b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.509611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad73800a-3bba-46e2-931f-b0faecc616b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.510232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73800a-3bba-46e2-931f-b0faecc616b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:21.512180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad73800a-3bba-46e2-931f-b0faecc616b8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:21.523706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:21.536465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1036/2091] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:21 2022] POST /identity/v3/users => generated 292 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:21.540414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390b138-a76a-49a7-b392-523a3387eb25 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:21.551266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7390b138-a76a-49a7-b392-523a3387eb25 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:21.556555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4cfaa-b03d-4eef-92b1-7d440d168ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:21.557172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4cfaa-b03d-4eef-92b1-7d440d168ce9 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.557470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4cfaa-b03d-4eef-92b1-7d440d168ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.557745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4cfaa-b03d-4eef-92b1-7d440d168ce9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.558381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4cfaa-b03d-4eef-92b1-7d440d168ce9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:21.560020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4cfaa-b03d-4eef-92b1-7d440d168ce9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:21.570555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1056/2092] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:07:21.574590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73800a-3bba-46e2-931f-b0faecc616b8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:21.585152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad73800a-3bba-46e2-931f-b0faecc616b8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:21.590611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd57998-d78c-4248-b865-b92d40273148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:21.591238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd57998-d78c-4248-b865-b92d40273148 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.591546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd57998-d78c-4248-b865-b92d40273148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.591826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd57998-d78c-4248-b865-b92d40273148 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.592506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd57998-d78c-4248-b865-b92d40273148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:21.594339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd57998-d78c-4248-b865-b92d40273148 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:21.606045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1037/2093] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:21.610258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4cfaa-b03d-4eef-92b1-7d440d168ce9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:21.620890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4cfaa-b03d-4eef-92b1-7d440d168ce9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:21.626321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da917b-2da0-47ef-817a-1ee6765b457e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:21.627028 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da917b-2da0-47ef-817a-1ee6765b457e admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.627306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da917b-2da0-47ef-817a-1ee6765b457e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.627592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08da917b-2da0-47ef-817a-1ee6765b457e admin admin] PATH_INFO: `/v3/projects/b81c586cd18a4f2388ed587e3d8dc91e/users/669d65a77b86437994ec57630d15561d/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.642541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da917b-2da0-47ef-817a-1ee6765b457e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b81c586cd18a4f2388ed587e3d8dc91e, user_id=669d65a77b86437994ec57630d15561d, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:21.645581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08da917b-2da0-47ef-817a-1ee6765b457e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:21.660307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1057/2094] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:21 2022] PUT /identity/v3/projects/b81c586cd18a4f2388ed587e3d8dc91e/users/669d65a77b86437994ec57630d15561d/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:21.673053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e805109-24d7-4e3a-a015-55e7fbe04c5f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.673454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e805109-24d7-4e3a-a015-55e7fbe04c5f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.673817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e805109-24d7-4e3a-a015-55e7fbe04c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.703756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6e805109-24d7-4e3a-a015-55e7fbe04c5f None None] MFA Rules not processed for user `669d65a77b86437994ec57630d15561d`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:21.704968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6e805109-24d7-4e3a-a015-55e7fbe04c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:21.785107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1038/2095] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:21 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:21.796261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da917b-2da0-47ef-817a-1ee6765b457e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:21.798119 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-08da917b-2da0-47ef-817a-1ee6765b457e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:21.846566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:21.866978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08da917b-2da0-47ef-817a-1ee6765b457e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:21.879864 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60d45d-a6a9-4b80-97b4-9d46912261e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:21.880667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d45d-a6a9-4b80-97b4-9d46912261e1 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:21.880940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d45d-a6a9-4b80-97b4-9d46912261e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:21.881362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60d45d-a6a9-4b80-97b4-9d46912261e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:21.891523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60d45d-a6a9-4b80-97b4-9d46912261e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:21.894254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60d45d-a6a9-4b80-97b4-9d46912261e1 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:21.903768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1058/2096] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:21 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:31.781611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=39 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:31.899656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=9 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:32.660974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e805109-24d7-4e3a-a015-55e7fbe04c5f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:32.731812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e805109-24d7-4e3a-a015-55e7fbe04c5f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:32.736334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:32.737270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:32.737554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:32.737831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] PATH_INFO: `/v3/users/669d65a77b86437994ec57630d15561d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:32.739105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=669d65a77b86437994ec57630d15561d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:32.741054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:32.803327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669d65a77b86437994ec57630d15561d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:32.804397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669d65a77b86437994ec57630d15561d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:32.805013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669d65a77b86437994ec57630d15561d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:32.817659 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669d65a77b86437994ec57630d15561d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:32.827259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669d65a77b86437994ec57630d15561d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:32.842710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1039/2097] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:07:32 2022] DELETE /identity/v3/users/669d65a77b86437994ec57630d15561d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:32.847319 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9245d-7d0b-4091-a8b3-24038df40b0e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:32.847603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9245d-7d0b-4091-a8b3-24038df40b0e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:32.847876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd9245d-7d0b-4091-a8b3-24038df40b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:32.867288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-4dd9245d-7d0b-4091-a8b3-24038df40b0e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:32.868457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4dd9245d-7d0b-4091-a8b3-24038df40b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:32.930335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1059/2098] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:32.940584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:32.942405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:33.001305 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5eec1-350b-4151-b083-8081c81f3fe6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:33.005223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114c52b5-6998-4a8b-b87e-4280433d49dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:33.005823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c52b5-6998-4a8b-b87e-4280433d49dd service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.006098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c52b5-6998-4a8b-b87e-4280433d49dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.006362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114c52b5-6998-4a8b-b87e-4280433d49dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.019945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c52b5-6998-4a8b-b87e-4280433d49dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:33.021431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114c52b5-6998-4a8b-b87e-4280433d49dd service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:33.031758 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1040/2099] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:33.384233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9245d-7d0b-4091-a8b3-24038df40b0e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:33.385793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4dd9245d-7d0b-4091-a8b3-24038df40b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:33.399691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd9245d-7d0b-4091-a8b3-24038df40b0e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:33.404967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:33.405684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.406031 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.406308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] PATH_INFO: `/v3/projects/b81c586cd18a4f2388ed587e3d8dc91e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.407505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b81c586cd18a4f2388ed587e3d8dc91e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:33.409805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:33.458961 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b81c586cd18a4f2388ed587e3d8dc91e', 'request_id': 'req-90351f19-88fc-4882-bea0-8e5a423b42c6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:33.464331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b81c586cd18a4f2388ed587e3d8dc91e', 'request_id': 'req-90351f19-88fc-4882-bea0-8e5a423b42c6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:33.473015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b81c586cd18a4f2388ed587e3d8dc91e', 'request_id': 'req-90351f19-88fc-4882-bea0-8e5a423b42c6'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:33.484707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] The token cache is being invalidate because project b81c586cd18a4f2388ed587e3d8dc91e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:07:33.484999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:33.485647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-90351f19-88fc-4882-bea0-8e5a423b42c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:33.487314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1060/2100] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:07:33 2022] DELETE /identity/v3/projects/b81c586cd18a4f2388ed587e3d8dc91e => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:33.492627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eec66f-4246-4e0a-b73f-6ed6d754cd06 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.493089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eec66f-4246-4e0a-b73f-6ed6d754cd06 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.493364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0eec66f-4246-4e0a-b73f-6ed6d754cd06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.515130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a0eec66f-4246-4e0a-b73f-6ed6d754cd06 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:33.516620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a0eec66f-4246-4e0a-b73f-6ed6d754cd06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:33.540697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:33.601515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1041/2101] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:33.609667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836e437-ccb6-44c3-ba81-2de4c9d7279f None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.609950 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836e437-ccb6-44c3-ba81-2de4c9d7279f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.610220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a836e437-ccb6-44c3-ba81-2de4c9d7279f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.631022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-a836e437-ccb6-44c3-ba81-2de4c9d7279f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:33.632247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a836e437-ccb6-44c3-ba81-2de4c9d7279f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:33.641306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1061/2102] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:33.651733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eec66f-4246-4e0a-b73f-6ed6d754cd06 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:33.663148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0eec66f-4246-4e0a-b73f-6ed6d754cd06 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:33.668630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801b079-8347-455e-979c-a4a5999dbc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:33.669939 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b079-8347-455e-979c-a4a5999dbc20 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.670236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b079-8347-455e-979c-a4a5999dbc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.670502 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5801b079-8347-455e-979c-a4a5999dbc20 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.671202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b079-8347-455e-979c-a4a5999dbc20 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:07:33.671496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b079-8347-455e-979c-a4a5999dbc20 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:33.673113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5801b079-8347-455e-979c-a4a5999dbc20 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:33.687066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1042/2103] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:07:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:07:33.693356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836e437-ccb6-44c3-ba81-2de4c9d7279f None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:33.703765 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a836e437-ccb6-44c3-ba81-2de4c9d7279f None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:33.709156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18522c8-e76d-4695-ba63-46e022d3b344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:33.709775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18522c8-e76d-4695-ba63-46e022d3b344 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.710052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18522c8-e76d-4695-ba63-46e022d3b344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.710313 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18522c8-e76d-4695-ba63-46e022d3b344 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.711002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18522c8-e76d-4695-ba63-46e022d3b344 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:33.712949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18522c8-e76d-4695-ba63-46e022d3b344 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:33.742079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1062/2104] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:33 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:33.746430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801b079-8347-455e-979c-a4a5999dbc20 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:33.757335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5801b079-8347-455e-979c-a4a5999dbc20 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:33.826385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb273ff-79b1-48d3-ad5d-fbabaace7f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:33.827118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb273ff-79b1-48d3-ad5d-fbabaace7f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.827425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb273ff-79b1-48d3-ad5d-fbabaace7f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.827710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb273ff-79b1-48d3-ad5d-fbabaace7f78 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.828348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb273ff-79b1-48d3-ad5d-fbabaace7f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:33.830324 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb273ff-79b1-48d3-ad5d-fbabaace7f78 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:33.866989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1043/2105] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:33 2022] POST /identity/v3/users => generated 288 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:33.871442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18522c8-e76d-4695-ba63-46e022d3b344 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:33.882759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18522c8-e76d-4695-ba63-46e022d3b344 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:33.887689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c190-b611-4f6d-a07b-9a170c1e530f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:33.888299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c190-b611-4f6d-a07b-9a170c1e530f admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.888584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c190-b611-4f6d-a07b-9a170c1e530f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.888850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b8c190-b611-4f6d-a07b-9a170c1e530f admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.889567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8c190-b611-4f6d-a07b-9a170c1e530f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:33.891333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b8c190-b611-4f6d-a07b-9a170c1e530f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:33.902755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1063/2106] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:07:33.907292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb273ff-79b1-48d3-ad5d-fbabaace7f78 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:33.918211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb273ff-79b1-48d3-ad5d-fbabaace7f78 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:33.923180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f655c84-91b2-4fa4-948d-fbbfc8ac6e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:33.923771 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655c84-91b2-4fa4-948d-fbbfc8ac6e7c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.924044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655c84-91b2-4fa4-948d-fbbfc8ac6e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.924324 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f655c84-91b2-4fa4-948d-fbbfc8ac6e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.925060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f655c84-91b2-4fa4-948d-fbbfc8ac6e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:33.926990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f655c84-91b2-4fa4-948d-fbbfc8ac6e7c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:33.939678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1044/2107] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:33.944079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c190-b611-4f6d-a07b-9a170c1e530f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:33.954455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b8c190-b611-4f6d-a07b-9a170c1e530f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:33.959651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725b171-df87-4e1c-949b-d2f889068ce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:33.960309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725b171-df87-4e1c-949b-d2f889068ce9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:33.960590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725b171-df87-4e1c-949b-d2f889068ce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:33.960863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4725b171-df87-4e1c-949b-d2f889068ce9 admin admin] PATH_INFO: `/v3/projects/9c08340307a44723b50469da0f129951/users/6db8f56a8d8c45c6b535afdd6d753daf/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:33.976829 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725b171-df87-4e1c-949b-d2f889068ce9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c08340307a44723b50469da0f129951, user_id=6db8f56a8d8c45c6b535afdd6d753daf, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:33.979609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4725b171-df87-4e1c-949b-d2f889068ce9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:33.996454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1064/2108] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:33 2022] PUT /identity/v3/projects/9c08340307a44723b50469da0f129951/users/6db8f56a8d8c45c6b535afdd6d753daf/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:34.007155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d049d54-af9f-4501-a279-0400fb38dbc9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:34.007438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d049d54-af9f-4501-a279-0400fb38dbc9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:34.007711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d049d54-af9f-4501-a279-0400fb38dbc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:34.038036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1d049d54-af9f-4501-a279-0400fb38dbc9 None None] MFA Rules not processed for user `6db8f56a8d8c45c6b535afdd6d753daf`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:34.039304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1d049d54-af9f-4501-a279-0400fb38dbc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:34.110762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1045/2109] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:34.117615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725b171-df87-4e1c-949b-d2f889068ce9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:34.144828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:34.193204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4725b171-df87-4e1c-949b-d2f889068ce9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:34.198659 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dc295-2420-4866-8b95-6fad89f8c4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:34.199306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc295-2420-4866-8b95-6fad89f8c4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:34.199579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc295-2420-4866-8b95-6fad89f8c4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:34.199853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854dc295-2420-4866-8b95-6fad89f8c4f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:34.200490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dc295-2420-4866-8b95-6fad89f8c4f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:34.202460 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854dc295-2420-4866-8b95-6fad89f8c4f1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:34.234132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1065/2110] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:34 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:34.238877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d049d54-af9f-4501-a279-0400fb38dbc9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:34.250223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d049d54-af9f-4501-a279-0400fb38dbc9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:34.263415 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:34.318720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9f33-f5fa-4ebb-b274-8014bb69454d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:34.319325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9f33-f5fa-4ebb-b274-8014bb69454d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:34.319598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9f33-f5fa-4ebb-b274-8014bb69454d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:34.319889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796e9f33-f5fa-4ebb-b274-8014bb69454d admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:34.320557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e9f33-f5fa-4ebb-b274-8014bb69454d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:34.322526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-796e9f33-f5fa-4ebb-b274-8014bb69454d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:34.346631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1046/2111] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:34 2022] POST /identity/v3/users => generated 293 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:34.350847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dc295-2420-4866-8b95-6fad89f8c4f1 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:34.361511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854dc295-2420-4866-8b95-6fad89f8c4f1 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:34.366980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad71e1-8178-4493-aa27-a0162b42ad95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:34.367646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad71e1-8178-4493-aa27-a0162b42ad95 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:34.367892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad71e1-8178-4493-aa27-a0162b42ad95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:34.368134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ad71e1-8178-4493-aa27-a0162b42ad95 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:34.368834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad71e1-8178-4493-aa27-a0162b42ad95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:34.370448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ad71e1-8178-4493-aa27-a0162b42ad95 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:34.381304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1066/2112] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:34.387949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9f33-f5fa-4ebb-b274-8014bb69454d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:34.399357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-796e9f33-f5fa-4ebb-b274-8014bb69454d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:34.404432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88819598-7a80-41ca-b6ef-69407494e3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:34.405100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819598-7a80-41ca-b6ef-69407494e3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:34.405886 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819598-7a80-41ca-b6ef-69407494e3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:34.405886 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88819598-7a80-41ca-b6ef-69407494e3fd admin admin] PATH_INFO: `/v3/projects/5d94469546814e679b09d292a766a0b3/users/983479b5d1b64bd8bf713d9aa8562835/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:34.422040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88819598-7a80-41ca-b6ef-69407494e3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d94469546814e679b09d292a766a0b3, user_id=983479b5d1b64bd8bf713d9aa8562835, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:34.424801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88819598-7a80-41ca-b6ef-69407494e3fd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:34.442862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1047/2113] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:34 2022] PUT /identity/v3/projects/5d94469546814e679b09d292a766a0b3/users/983479b5d1b64bd8bf713d9aa8562835/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:34.446954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad71e1-8178-4493-aa27-a0162b42ad95 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:34.457672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ad71e1-8178-4493-aa27-a0162b42ad95 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:34.519424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa98e31-6886-420c-abd5-2d3d22bed4a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:34.520086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98e31-6886-420c-abd5-2d3d22bed4a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:34.520367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98e31-6886-420c-abd5-2d3d22bed4a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:34.520639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa98e31-6886-420c-abd5-2d3d22bed4a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:34.521292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98e31-6886-420c-abd5-2d3d22bed4a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:34.522956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa98e31-6886-420c-abd5-2d3d22bed4a4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:34.533274 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1067/2114] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:34 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:34.537852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88819598-7a80-41ca-b6ef-69407494e3fd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:34.550363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88819598-7a80-41ca-b6ef-69407494e3fd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:34.556029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eae512-a95d-4f60-8aa4-47321a5bb3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:34.556818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eae512-a95d-4f60-8aa4-47321a5bb3b2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:34.557096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eae512-a95d-4f60-8aa4-47321a5bb3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:34.557366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eae512-a95d-4f60-8aa4-47321a5bb3b2 admin admin] PATH_INFO: `/v3/projects/5d94469546814e679b09d292a766a0b3/users/983479b5d1b64bd8bf713d9aa8562835/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:34.560380 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eae512-a95d-4f60-8aa4-47321a5bb3b2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d94469546814e679b09d292a766a0b3, user_id=983479b5d1b64bd8bf713d9aa8562835, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:34.563246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eae512-a95d-4f60-8aa4-47321a5bb3b2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:34.578400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1048/2115] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:34 2022] PUT /identity/v3/projects/5d94469546814e679b09d292a766a0b3/users/983479b5d1b64bd8bf713d9aa8562835/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:34.590150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ce486-c2ef-4e8e-9766-fe390c9042ef None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:34.590432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ce486-c2ef-4e8e-9766-fe390c9042ef None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:34.590701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1ce486-c2ef-4e8e-9766-fe390c9042ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:34.625686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-1b1ce486-c2ef-4e8e-9766-fe390c9042ef None None] MFA Rules not processed for user `983479b5d1b64bd8bf713d9aa8562835`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:34.627217 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-1b1ce486-c2ef-4e8e-9766-fe390c9042ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:34.708190 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1068/2116] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:34.719816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eae512-a95d-4f60-8aa4-47321a5bb3b2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:34.721814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-21eae512-a95d-4f60-8aa4-47321a5bb3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:34.795337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eae512-a95d-4f60-8aa4-47321a5bb3b2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:34.798940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f819e967-cbae-416b-88eb-a062a2a43980 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:34.799657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819e967-cbae-416b-88eb-a062a2a43980 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:34.800106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819e967-cbae-416b-88eb-a062a2a43980 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:34.800286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f819e967-cbae-416b-88eb-a062a2a43980 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:34.860355 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819e967-cbae-416b-88eb-a062a2a43980 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:34.861873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f819e967-cbae-416b-88eb-a062a2a43980 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:34.871480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1049/2117] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:38.521948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ce486-c2ef-4e8e-9766-fe390c9042ef None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:38.544366 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:38.622269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1ce486-c2ef-4e8e-9766-fe390c9042ef None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:38.627691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:38.629298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:38.629423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:38.629794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] PATH_INFO: `/v3/users/6db8f56a8d8c45c6b535afdd6d753daf` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:38.631037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6db8f56a8d8c45c6b535afdd6d753daf)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:38.633843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:38.704744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6db8f56a8d8c45c6b535afdd6d753daf'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:38.718620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6db8f56a8d8c45c6b535afdd6d753daf'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:38.728170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6db8f56a8d8c45c6b535afdd6d753daf'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:38.736035 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6db8f56a8d8c45c6b535afdd6d753daf'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:38.737063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6db8f56a8d8c45c6b535afdd6d753daf'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:38.745672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1069/2118] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:07:38 2022] DELETE /identity/v3/users/6db8f56a8d8c45c6b535afdd6d753daf => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:38.750494 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787db1fd-7806-4dda-ba77-9637ea35d23e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:38.751059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787db1fd-7806-4dda-ba77-9637ea35d23e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:38.751059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787db1fd-7806-4dda-ba77-9637ea35d23e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:38.773560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-787db1fd-7806-4dda-ba77-9637ea35d23e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:38.774742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-787db1fd-7806-4dda-ba77-9637ea35d23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:38.795490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:38.867272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1050/2119] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:38.874474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:38.876053 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:38.945794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df4d864-224b-472b-a8af-1409cbac88f6 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:38.949690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a508fe7-0da3-497c-bf35-1b2b100592a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:38.950396 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508fe7-0da3-497c-bf35-1b2b100592a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:38.950589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508fe7-0da3-497c-bf35-1b2b100592a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:38.950965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a508fe7-0da3-497c-bf35-1b2b100592a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:38.961327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a508fe7-0da3-497c-bf35-1b2b100592a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:38.962806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a508fe7-0da3-497c-bf35-1b2b100592a8 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:38.972851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1070/2120] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:07:39.356665 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787db1fd-7806-4dda-ba77-9637ea35d23e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:39.361799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-787db1fd-7806-4dda-ba77-9637ea35d23e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:39.391282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787db1fd-7806-4dda-ba77-9637ea35d23e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:39.402806 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:39.404319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:39.404604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:39.404952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] PATH_INFO: `/v3/projects/9c08340307a44723b50469da0f129951` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:39.406333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c08340307a44723b50469da0f129951)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:39.410515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:39.481786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c08340307a44723b50469da0f129951', 'request_id': 'req-3efeac07-3ce0-4e97-a939-1c6d55fbba18'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:39.491270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c08340307a44723b50469da0f129951', 'request_id': 'req-3efeac07-3ce0-4e97-a939-1c6d55fbba18'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:39.498705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c08340307a44723b50469da0f129951', 'request_id': 'req-3efeac07-3ce0-4e97-a939-1c6d55fbba18'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:39.512793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] The token cache is being invalidate because project 9c08340307a44723b50469da0f129951 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:07:39.513086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:39.513820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:39.515423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1051/2121] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:07:39 2022] DELETE /identity/v3/projects/9c08340307a44723b50469da0f129951 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:39.520164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a508fe7-0da3-497c-bf35-1b2b100592a8 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:39.530957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a508fe7-0da3-497c-bf35-1b2b100592a8 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:39.566928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:39.592529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:39.593162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:39.593495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:39.593755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] PATH_INFO: `/v3/users/983479b5d1b64bd8bf713d9aa8562835` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:39.594922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] RBAC: Authorizing `identity:delete_user(user_id=983479b5d1b64bd8bf713d9aa8562835)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:39.597513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:39.659393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '983479b5d1b64bd8bf713d9aa8562835'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:39.672198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '983479b5d1b64bd8bf713d9aa8562835'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:39.681658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '983479b5d1b64bd8bf713d9aa8562835'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:39.689183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '983479b5d1b64bd8bf713d9aa8562835'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:39.690155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f853f0ef-1119-4be6-967b-08879f592bef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '983479b5d1b64bd8bf713d9aa8562835'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:39.697390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1071/2122] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:07:39 2022] DELETE /identity/v3/users/983479b5d1b64bd8bf713d9aa8562835 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:40.033782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:40.035797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:40.053177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efeac07-3ce0-4e97-a939-1c6d55fbba18 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:40.115481 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:40.116112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.116391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.116663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] PATH_INFO: `/v3/projects/5d94469546814e679b09d292a766a0b3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.117836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d94469546814e679b09d292a766a0b3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:40.119801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:40.174128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d94469546814e679b09d292a766a0b3', 'request_id': 'req-622019b9-1e9c-4a08-b6f7-d40438edcc63'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:40.176105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:40.184332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d94469546814e679b09d292a766a0b3', 'request_id': 'req-622019b9-1e9c-4a08-b6f7-d40438edcc63'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:40.191501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d94469546814e679b09d292a766a0b3', 'request_id': 'req-622019b9-1e9c-4a08-b6f7-d40438edcc63'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:40.203480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] The token cache is being invalidate because project 5d94469546814e679b09d292a766a0b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:07:40.203770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:40.204482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-622019b9-1e9c-4a08-b6f7-d40438edcc63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:40.206226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1052/2123] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:07:40 2022] DELETE /identity/v3/projects/5d94469546814e679b09d292a766a0b3 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:40.211921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb72dd-ad32-4dc9-8ad3-b930562015c8 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.212211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb72dd-ad32-4dc9-8ad3-b930562015c8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.212486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb72dd-ad32-4dc9-8ad3-b930562015c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.235027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-28cb72dd-ad32-4dc9-8ad3-b930562015c8 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:40.236267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-28cb72dd-ad32-4dc9-8ad3-b930562015c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:40.306803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1072/2124] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:40.317877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182741f8-a244-4d1a-b186-8ac195f2c48f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.318107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182741f8-a244-4d1a-b186-8ac195f2c48f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.318381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182741f8-a244-4d1a-b186-8ac195f2c48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.344664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-182741f8-a244-4d1a-b186-8ac195f2c48f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:40.345888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-182741f8-a244-4d1a-b186-8ac195f2c48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:40.355686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1053/2125] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:40.360337 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb72dd-ad32-4dc9-8ad3-b930562015c8 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:40.375056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb72dd-ad32-4dc9-8ad3-b930562015c8 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:40.385333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aa007-ea29-4256-a094-df4e5b024203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:40.385333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aa007-ea29-4256-a094-df4e5b024203 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.385333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aa007-ea29-4256-a094-df4e5b024203 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.385333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576aa007-ea29-4256-a094-df4e5b024203 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.385683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576aa007-ea29-4256-a094-df4e5b024203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:07:40.385683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576aa007-ea29-4256-a094-df4e5b024203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:40.385683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-576aa007-ea29-4256-a094-df4e5b024203 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:40.398815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1073/2126] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:07:40.403615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182741f8-a244-4d1a-b186-8ac195f2c48f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:40.421754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182741f8-a244-4d1a-b186-8ac195f2c48f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:40.427783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e2f0-9187-4e1a-9f97-39d1b72b57e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:40.428573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e2f0-9187-4e1a-9f97-39d1b72b57e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.428956 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e2f0-9187-4e1a-9f97-39d1b72b57e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.429315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c77e2f0-9187-4e1a-9f97-39d1b72b57e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.430215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e2f0-9187-4e1a-9f97-39d1b72b57e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:40.434162 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c77e2f0-9187-4e1a-9f97-39d1b72b57e9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:40.478862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1054/2127] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:40 2022] POST /identity/v3/projects => generated 373 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:07:40.479187 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aa007-ea29-4256-a094-df4e5b024203 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:40.498804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-576aa007-ea29-4256-a094-df4e5b024203 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:40.560107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:40.592694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3760f-81c2-4682-9aa8-ddefb844140b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:40.593750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3760f-81c2-4682-9aa8-ddefb844140b admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.594131 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3760f-81c2-4682-9aa8-ddefb844140b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.594488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc3760f-81c2-4682-9aa8-ddefb844140b admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.595376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3760f-81c2-4682-9aa8-ddefb844140b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:40.598855 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc3760f-81c2-4682-9aa8-ddefb844140b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:40.623383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1074/2128] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:40 2022] POST /identity/v3/users => generated 287 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:40.627443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e2f0-9187-4e1a-9f97-39d1b72b57e9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:40.638199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c77e2f0-9187-4e1a-9f97-39d1b72b57e9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:40.642919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9daa5e-9309-4f50-a4a7-ab89c1ed1e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:40.643887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9daa5e-9309-4f50-a4a7-ab89c1ed1e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.644161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9daa5e-9309-4f50-a4a7-ab89c1ed1e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.644428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9daa5e-9309-4f50-a4a7-ab89c1ed1e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.645074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9daa5e-9309-4f50-a4a7-ab89c1ed1e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:40.646663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9daa5e-9309-4f50-a4a7-ab89c1ed1e8d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:40.661530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1055/2129] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:40.663183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3760f-81c2-4682-9aa8-ddefb844140b admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:40.689515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc3760f-81c2-4682-9aa8-ddefb844140b admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:40.696308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41416d4-7e31-4dd5-8075-53f7f8a18f1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:40.697010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41416d4-7e31-4dd5-8075-53f7f8a18f1d admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.697468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41416d4-7e31-4dd5-8075-53f7f8a18f1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.697844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41416d4-7e31-4dd5-8075-53f7f8a18f1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.698633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41416d4-7e31-4dd5-8075-53f7f8a18f1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:40.700522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41416d4-7e31-4dd5-8075-53f7f8a18f1d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:40.715986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1075/2130] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:40 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:40.723177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9daa5e-9309-4f50-a4a7-ab89c1ed1e8d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:40.734041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9daa5e-9309-4f50-a4a7-ab89c1ed1e8d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:40.739326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72eb7e-771c-4ecd-a3ef-c43b1b5702cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:40.739958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72eb7e-771c-4ecd-a3ef-c43b1b5702cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.740239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72eb7e-771c-4ecd-a3ef-c43b1b5702cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.740500 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc72eb7e-771c-4ecd-a3ef-c43b1b5702cc admin admin] PATH_INFO: `/v3/projects/07a67ee5f6a148bc829b22f974882ed6/users/01b362945245485f95d2654c11c05fdb/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.755839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72eb7e-771c-4ecd-a3ef-c43b1b5702cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a67ee5f6a148bc829b22f974882ed6, user_id=01b362945245485f95d2654c11c05fdb, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:40.758647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc72eb7e-771c-4ecd-a3ef-c43b1b5702cc admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:40.779353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1056/2131] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:40 2022] PUT /identity/v3/projects/07a67ee5f6a148bc829b22f974882ed6/users/01b362945245485f95d2654c11c05fdb/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:40.789998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95a0f6-b0f6-46ee-9080-b441b743d0d1 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.790367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95a0f6-b0f6-46ee-9080-b441b743d0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.790706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e95a0f6-b0f6-46ee-9080-b441b743d0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.818449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-1e95a0f6-b0f6-46ee-9080-b441b743d0d1 None None] MFA Rules not processed for user `01b362945245485f95d2654c11c05fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:40.819850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-1e95a0f6-b0f6-46ee-9080-b441b743d0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:40.885198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1076/2132] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:40.897948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72eb7e-771c-4ecd-a3ef-c43b1b5702cc admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:40.900063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cc72eb7e-771c-4ecd-a3ef-c43b1b5702cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:40.970812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc72eb7e-771c-4ecd-a3ef-c43b1b5702cc admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:40.975663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7aa06d-5069-46f7-b188-65740e81a5c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:40.976292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aa06d-5069-46f7-b188-65740e81a5c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:40.976599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aa06d-5069-46f7-b188-65740e81a5c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:40.976872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7aa06d-5069-46f7-b188-65740e81a5c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:40.987774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7aa06d-5069-46f7-b188-65740e81a5c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:40.989396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7aa06d-5069-46f7-b188-65740e81a5c9 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:40.999162 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1057/2133] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:41.028085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95a0f6-b0f6-46ee-9080-b441b743d0d1 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:41.099059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e95a0f6-b0f6-46ee-9080-b441b743d0d1 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:41.103912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:41.104565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:41.104840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:41.105108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] PATH_INFO: `/v3/users/01b362945245485f95d2654c11c05fdb` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:41.106338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b362945245485f95d2654c11c05fdb)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:41.108294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:41.179755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b362945245485f95d2654c11c05fdb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:41.190063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:41.204302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b362945245485f95d2654c11c05fdb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:41.214276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b362945245485f95d2654c11c05fdb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:41.226676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b362945245485f95d2654c11c05fdb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:41.227650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b362945245485f95d2654c11c05fdb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:41.245470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1077/2134] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:07:41 2022] DELETE /identity/v3/users/01b362945245485f95d2654c11c05fdb => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:41.250024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be69cc-012a-4240-9b9d-59a5dd787a90 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:41.250979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be69cc-012a-4240-9b9d-59a5dd787a90 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:41.251255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78be69cc-012a-4240-9b9d-59a5dd787a90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:41.272075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-78be69cc-012a-4240-9b9d-59a5dd787a90 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:41.273288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-78be69cc-012a-4240-9b9d-59a5dd787a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:41.339420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1058/2135] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:41.350417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:41.351979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:41.415227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb98c818-0f9c-4624-8e6e-0cf1e57f482e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:41.418913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630077ef-89c1-478f-a5bf-7289a1d0b37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:41.419586 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630077ef-89c1-478f-a5bf-7289a1d0b37f service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:41.419833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630077ef-89c1-478f-a5bf-7289a1d0b37f service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:41.420103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630077ef-89c1-478f-a5bf-7289a1d0b37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:41.429638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630077ef-89c1-478f-a5bf-7289a1d0b37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:41.431108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630077ef-89c1-478f-a5bf-7289a1d0b37f service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:41.440903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1078/2136] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:41.781185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be69cc-012a-4240-9b9d-59a5dd787a90 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:41.782902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-78be69cc-012a-4240-9b9d-59a5dd787a90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:41.807203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78be69cc-012a-4240-9b9d-59a5dd787a90 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:41.821420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:41.822151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:41.822485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:41.822640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] PATH_INFO: `/v3/projects/07a67ee5f6a148bc829b22f974882ed6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:41.825248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a67ee5f6a148bc829b22f974882ed6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:41.827415 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:41.848462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:41.903337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a67ee5f6a148bc829b22f974882ed6', 'request_id': 'req-a0ea7209-0c35-46e6-8ba0-a712e45c046e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:41.916574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a67ee5f6a148bc829b22f974882ed6', 'request_id': 'req-a0ea7209-0c35-46e6-8ba0-a712e45c046e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:41.923858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a67ee5f6a148bc829b22f974882ed6', 'request_id': 'req-a0ea7209-0c35-46e6-8ba0-a712e45c046e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:41.936841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] The token cache is being invalidate because project 07a67ee5f6a148bc829b22f974882ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:07:41.937147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:41.937782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a0ea7209-0c35-46e6-8ba0-a712e45c046e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:41.939402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1059/2137] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:07:41 2022] DELETE /identity/v3/projects/07a67ee5f6a148bc829b22f974882ed6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:41.946077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce1ea-57d7-4618-9dee-8514204bbf60 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:41.946763 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce1ea-57d7-4618-9dee-8514204bbf60 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:41.946763 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804ce1ea-57d7-4618-9dee-8514204bbf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:41.975245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-804ce1ea-57d7-4618-9dee-8514204bbf60 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:41.976649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-804ce1ea-57d7-4618-9dee-8514204bbf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:42.055841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1079/2138] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:42.065543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba1dc2-87a7-491c-8119-03e332633756 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.066118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba1dc2-87a7-491c-8119-03e332633756 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.066118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ba1dc2-87a7-491c-8119-03e332633756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.089372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-37ba1dc2-87a7-491c-8119-03e332633756 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:42.090644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-37ba1dc2-87a7-491c-8119-03e332633756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:42.099070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1060/2139] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:42.103667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce1ea-57d7-4618-9dee-8514204bbf60 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:42.113956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804ce1ea-57d7-4618-9dee-8514204bbf60 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:42.118757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b7d50-e68e-4a9a-9426-4619d0644632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:42.119419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b7d50-e68e-4a9a-9426-4619d0644632 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.119698 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b7d50-e68e-4a9a-9426-4619d0644632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.119969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67b7d50-e68e-4a9a-9426-4619d0644632 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.120635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b7d50-e68e-4a9a-9426-4619d0644632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:07:42.120934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b7d50-e68e-4a9a-9426-4619d0644632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:42.122593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67b7d50-e68e-4a9a-9426-4619d0644632 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:42.135519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1080/2140] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:07:42.140443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba1dc2-87a7-491c-8119-03e332633756 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:42.153066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ba1dc2-87a7-491c-8119-03e332633756 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:42.166439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c05b6d-12d5-437b-9821-5541b36352f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:42.167219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c05b6d-12d5-437b-9821-5541b36352f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.167569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c05b6d-12d5-437b-9821-5541b36352f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.168018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c05b6d-12d5-437b-9821-5541b36352f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.168545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c05b6d-12d5-437b-9821-5541b36352f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:42.170517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c05b6d-12d5-437b-9821-5541b36352f4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:42.200732 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1061/2141] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:42 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:42.205291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b7d50-e68e-4a9a-9426-4619d0644632 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:42.218879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67b7d50-e68e-4a9a-9426-4619d0644632 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:42.284515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485c429-bb3c-4eb3-81f6-3bbf507ed5c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:42.285220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c429-bb3c-4eb3-81f6-3bbf507ed5c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.285478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c429-bb3c-4eb3-81f6-3bbf507ed5c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.285739 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7485c429-bb3c-4eb3-81f6-3bbf507ed5c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.286474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485c429-bb3c-4eb3-81f6-3bbf507ed5c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:42.288569 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7485c429-bb3c-4eb3-81f6-3bbf507ed5c2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:42.298459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:42.315544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1081/2142] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:42 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:42.320296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c05b6d-12d5-437b-9821-5541b36352f4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:42.331413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c05b6d-12d5-437b-9821-5541b36352f4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:42.336316 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a60eb-9f5e-43e7-ba56-a646a7c1df21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:42.337023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a60eb-9f5e-43e7-ba56-a646a7c1df21 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.337379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a60eb-9f5e-43e7-ba56-a646a7c1df21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.337754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a60eb-9f5e-43e7-ba56-a646a7c1df21 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.338410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a60eb-9f5e-43e7-ba56-a646a7c1df21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:42.340047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a60eb-9f5e-43e7-ba56-a646a7c1df21 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:42.352665 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1062/2143] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:42.357108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485c429-bb3c-4eb3-81f6-3bbf507ed5c2 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:42.367738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7485c429-bb3c-4eb3-81f6-3bbf507ed5c2 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:42.372494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a86e5c0-5bbc-4f08-86e4-a4d7061fa1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:42.373127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86e5c0-5bbc-4f08-86e4-a4d7061fa1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.373405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86e5c0-5bbc-4f08-86e4-a4d7061fa1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.373675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a86e5c0-5bbc-4f08-86e4-a4d7061fa1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.374335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86e5c0-5bbc-4f08-86e4-a4d7061fa1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:42.375977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a86e5c0-5bbc-4f08-86e4-a4d7061fa1a9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:42.387109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1082/2144] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:42.391532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a60eb-9f5e-43e7-ba56-a646a7c1df21 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:42.402897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a60eb-9f5e-43e7-ba56-a646a7c1df21 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:42.408917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2337a-a980-41d4-85d9-58b65a60b8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:42.409987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2337a-a980-41d4-85d9-58b65a60b8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.410217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2337a-a980-41d4-85d9-58b65a60b8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.410515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2337a-a980-41d4-85d9-58b65a60b8b3 admin admin] PATH_INFO: `/v3/projects/f714a6967cf34288a66d8cc0c328a147/users/bfe3817d4e7241e689e6ecc095e938ca/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.428127 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2337a-a980-41d4-85d9-58b65a60b8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f714a6967cf34288a66d8cc0c328a147, user_id=bfe3817d4e7241e689e6ecc095e938ca, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:42.430903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2337a-a980-41d4-85d9-58b65a60b8b3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:42.445789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1063/2145] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:42 2022] PUT /identity/v3/projects/f714a6967cf34288a66d8cc0c328a147/users/bfe3817d4e7241e689e6ecc095e938ca/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:42.450888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756958d-7b6c-4145-abbf-bac4716c79e3 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.451177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756958d-7b6c-4145-abbf-bac4716c79e3 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.451478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7756958d-7b6c-4145-abbf-bac4716c79e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.472110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7756958d-7b6c-4145-abbf-bac4716c79e3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:42.473333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7756958d-7b6c-4145-abbf-bac4716c79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:42.543305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1083/2146] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:42.553700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2337a-a980-41d4-85d9-58b65a60b8b3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:42.555738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a3f2337a-a980-41d4-85d9-58b65a60b8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:42.627583 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2337a-a980-41d4-85d9-58b65a60b8b3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:42.631579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96648cc-1943-4f1d-85fc-a8b3304e79ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:42.632256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96648cc-1943-4f1d-85fc-a8b3304e79ce service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.632536 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96648cc-1943-4f1d-85fc-a8b3304e79ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.632822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96648cc-1943-4f1d-85fc-a8b3304e79ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.644318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96648cc-1943-4f1d-85fc-a8b3304e79ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:42.645966 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96648cc-1943-4f1d-85fc-a8b3304e79ce service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:42.657778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1064/2147] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:42.731622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756958d-7b6c-4145-abbf-bac4716c79e3 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:42.733545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7756958d-7b6c-4145-abbf-bac4716c79e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:42.747631 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7756958d-7b6c-4145-abbf-bac4716c79e3 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:42.753511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:42.755285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.756077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.756405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] PATH_INFO: `/v3/users/b8a26d9a0a494c3cb4423049ef83e26d` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.757994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8a26d9a0a494c3cb4423049ef83e26d)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:42.761185 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:42.855020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8a26d9a0a494c3cb4423049ef83e26d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:42.878789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8a26d9a0a494c3cb4423049ef83e26d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:42.896727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8a26d9a0a494c3cb4423049ef83e26d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:42.907820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8a26d9a0a494c3cb4423049ef83e26d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:42.908597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8a26d9a0a494c3cb4423049ef83e26d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:42.915373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1084/2148] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:07:42 2022] DELETE /identity/v3/users/b8a26d9a0a494c3cb4423049ef83e26d => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:42.921082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a69954-b050-492d-8211-047fe57c9223 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:42.921430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a69954-b050-492d-8211-047fe57c9223 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:42.921791 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a69954-b050-492d-8211-047fe57c9223 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:42.944008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c6a69954-b050-492d-8211-047fe57c9223 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:42.945929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c6a69954-b050-492d-8211-047fe57c9223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:43.001533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:43.089704 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1065/2149] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:43.145123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:43.146799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:43.257142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b41039d-1b0a-47f2-9bd8-4ec9a22692ab admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:43.262113 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79800b3-5673-4d8f-a64e-91c616e56e51 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:43.262977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79800b3-5673-4d8f-a64e-91c616e56e51 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:43.263336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79800b3-5673-4d8f-a64e-91c616e56e51 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:43.263857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79800b3-5673-4d8f-a64e-91c616e56e51 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:43.274475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:43.278003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79800b3-5673-4d8f-a64e-91c616e56e51 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:43.280750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79800b3-5673-4d8f-a64e-91c616e56e51 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:43.298918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1085/2150] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:07:43.916718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a69954-b050-492d-8211-047fe57c9223 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:43.918726 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c6a69954-b050-492d-8211-047fe57c9223 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:43.947919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a69954-b050-492d-8211-047fe57c9223 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:43.953044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:43.953738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:43.953994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:43.954269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] PATH_INFO: `/v3/projects/0c706d1992854072bf20f45f119edfc8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:43.956327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c706d1992854072bf20f45f119edfc8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:43.959619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:44.041751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c706d1992854072bf20f45f119edfc8', 'request_id': 'req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:44.055475 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c706d1992854072bf20f45f119edfc8', 'request_id': 'req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:44.071467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c706d1992854072bf20f45f119edfc8', 'request_id': 'req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:44.096152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] The token cache is being invalidate because project 0c706d1992854072bf20f45f119edfc8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:07:44.097450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:44.098934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:44.108490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1066/2151] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:07:43 2022] DELETE /identity/v3/projects/0c706d1992854072bf20f45f119edfc8 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:44.109020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2d46-8a8b-4dc1-b7cf-eadad4cb8819 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.109637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2d46-8a8b-4dc1-b7cf-eadad4cb8819 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.111578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fd2d46-8a8b-4dc1-b7cf-eadad4cb8819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.173414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d1fd2d46-8a8b-4dc1-b7cf-eadad4cb8819 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:44.175288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d1fd2d46-8a8b-4dc1-b7cf-eadad4cb8819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:44.182714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:44.184941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:44.294675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1086/2152] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:44.298284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f501ef-3c10-4f77-9d91-8847a234f3a7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.298800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f501ef-3c10-4f77-9d91-8847a234f3a7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.299221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f501ef-3c10-4f77-9d91-8847a234f3a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.325378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-34f501ef-3c10-4f77-9d91-8847a234f3a7 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:44.325636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243fecc-4bb7-4775-9a88-eaa3b0a8b27d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:44.327307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-34f501ef-3c10-4f77-9d91-8847a234f3a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:44.335421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:44.336329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.336794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.337764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] PATH_INFO: `/v3/users/b9c0e2deb9e34c88beee125883190f28` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.340318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9c0e2deb9e34c88beee125883190f28)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:44.342227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1087/2153] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:44.345723 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:44.348043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f501ef-3c10-4f77-9d91-8847a234f3a7 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:44.361492 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f501ef-3c10-4f77-9d91-8847a234f3a7 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:44.367427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffb0f8-1b54-408c-966e-16af332c1ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:44.368249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffb0f8-1b54-408c-966e-16af332c1ccb admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.368726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffb0f8-1b54-408c-966e-16af332c1ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.369333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ffb0f8-1b54-408c-966e-16af332c1ccb admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.370194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffb0f8-1b54-408c-966e-16af332c1ccb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:07:44.370649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffb0f8-1b54-408c-966e-16af332c1ccb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:44.372785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ffb0f8-1b54-408c-966e-16af332c1ccb admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:44.408459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1088/2154] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:07:44.413826 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffb0f8-1b54-408c-966e-16af332c1ccb admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:44.454014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ffb0f8-1b54-408c-966e-16af332c1ccb admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:44.473905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9c0e2deb9e34c88beee125883190f28'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:44.474666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73794f-49e1-4ca6-9310-fdca02d41831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:44.475196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9c0e2deb9e34c88beee125883190f28'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:44.476195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73794f-49e1-4ca6-9310-fdca02d41831 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.476712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9c0e2deb9e34c88beee125883190f28'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:44.477082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73794f-49e1-4ca6-9310-fdca02d41831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.478552 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f73794f-49e1-4ca6-9310-fdca02d41831 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.480388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73794f-49e1-4ca6-9310-fdca02d41831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:44.484924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f73794f-49e1-4ca6-9310-fdca02d41831 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:44.516981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9c0e2deb9e34c88beee125883190f28'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:44.522664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:44.543917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bed0b1af-2b50-4269-b22f-fc0171b765c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9c0e2deb9e34c88beee125883190f28'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:44.572161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1089/2155] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:44 2022] POST /identity/v3/projects => generated 373 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:07:44.574133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1067/2156] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:07:44 2022] DELETE /identity/v3/users/b9c0e2deb9e34c88beee125883190f28 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:07:44.575406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73794f-49e1-4ca6-9310-fdca02d41831 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:44.578300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9373c4f-47b6-4b0b-8750-52bbdc876adb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.579651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2f73794f-49e1-4ca6-9310-fdca02d41831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:44.582297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9373c4f-47b6-4b0b-8750-52bbdc876adb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.582297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9373c4f-47b6-4b0b-8750-52bbdc876adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.624282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c9373c4f-47b6-4b0b-8750-52bbdc876adb None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:44.626927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c9373c4f-47b6-4b0b-8750-52bbdc876adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:44.726810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f73794f-49e1-4ca6-9310-fdca02d41831 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:44.758395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1068/2157] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:44.764044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9373c4f-47b6-4b0b-8750-52bbdc876adb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:44.766997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c9373c4f-47b6-4b0b-8750-52bbdc876adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:44.855561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb42c2-b29c-4196-a2ca-3f33e10fe8ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:44.856380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb42c2-b29c-4196-a2ca-3f33e10fe8ba admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.857355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb42c2-b29c-4196-a2ca-3f33e10fe8ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.857704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eb42c2-b29c-4196-a2ca-3f33e10fe8ba admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.859347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb42c2-b29c-4196-a2ca-3f33e10fe8ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:44.862702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73eb42c2-b29c-4196-a2ca-3f33e10fe8ba admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:44.878669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9373c4f-47b6-4b0b-8750-52bbdc876adb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:44.879542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:44.883300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0c63-2463-45bf-9452-bb931f790e55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:44.884373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0c63-2463-45bf-9452-bb931f790e55 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.884733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0c63-2463-45bf-9452-bb931f790e55 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.884981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b0c63-2463-45bf-9452-bb931f790e55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.910525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b0c63-2463-45bf-9452-bb931f790e55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:44.912033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b0c63-2463-45bf-9452-bb931f790e55 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:44.928764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1090/2158] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:44 2022] POST /identity/v3/users => generated 287 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:44.930076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb42c2-b29c-4196-a2ca-3f33e10fe8ba admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:44.930874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1069/2159] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:44.943234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eb42c2-b29c-4196-a2ca-3f33e10fe8ba admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:44.949457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed4a46-82f3-493a-a9c0-095b6f17531a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:44.950633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed4a46-82f3-493a-a9c0-095b6f17531a admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:44.950955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed4a46-82f3-493a-a9c0-095b6f17531a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:44.951228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed4a46-82f3-493a-a9c0-095b6f17531a admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:44.951993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed4a46-82f3-493a-a9c0-095b6f17531a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:44.953753 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed4a46-82f3-493a-a9c0-095b6f17531a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:44.972652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1091/2160] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:44.973853 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0c63-2463-45bf-9452-bb931f790e55 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:44.986288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b0c63-2463-45bf-9452-bb931f790e55 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:45.003187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288c05c3-a8de-4173-9b3a-63dfe98087ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:45.003851 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c05c3-a8de-4173-9b3a-63dfe98087ae admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:45.004127 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c05c3-a8de-4173-9b3a-63dfe98087ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:45.005537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288c05c3-a8de-4173-9b3a-63dfe98087ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:45.005537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c05c3-a8de-4173-9b3a-63dfe98087ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:45.006667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288c05c3-a8de-4173-9b3a-63dfe98087ae admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:45.020873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1070/2161] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:44 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:45.025629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed4a46-82f3-493a-a9c0-095b6f17531a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:45.041306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed4a46-82f3-493a-a9c0-095b6f17531a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:45.053638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469568c2-cec4-40b8-b499-832c392199a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:45.054553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469568c2-cec4-40b8-b499-832c392199a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:45.054883 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469568c2-cec4-40b8-b499-832c392199a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:45.055229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469568c2-cec4-40b8-b499-832c392199a3 admin admin] PATH_INFO: `/v3/projects/417f24e161274e708c3c0028f65f14b9/users/a1ca7baf9ac94d7fa1da9a9327316ca4/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:45.081690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469568c2-cec4-40b8-b499-832c392199a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=417f24e161274e708c3c0028f65f14b9, user_id=a1ca7baf9ac94d7fa1da9a9327316ca4, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:45.087277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469568c2-cec4-40b8-b499-832c392199a3 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:45.119058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1092/2162] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:45 2022] PUT /identity/v3/projects/417f24e161274e708c3c0028f65f14b9/users/a1ca7baf9ac94d7fa1da9a9327316ca4/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:45.132919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a7cb-c37f-4b12-b921-88b5c6fffa64 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:45.133257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a7cb-c37f-4b12-b921-88b5c6fffa64 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:45.133809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7662a7cb-c37f-4b12-b921-88b5c6fffa64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:45.170560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7662a7cb-c37f-4b12-b921-88b5c6fffa64 None None] MFA Rules not processed for user `a1ca7baf9ac94d7fa1da9a9327316ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:45.171837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7662a7cb-c37f-4b12-b921-88b5c6fffa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:45.303001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1071/2163] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:45.316621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469568c2-cec4-40b8-b499-832c392199a3 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:45.321574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-469568c2-cec4-40b8-b499-832c392199a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:45.413098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662a7cb-c37f-4b12-b921-88b5c6fffa64 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:45.416632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7662a7cb-c37f-4b12-b921-88b5c6fffa64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:45.432750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=98 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:45.469389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469568c2-cec4-40b8-b499-832c392199a3 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:45.475451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b90696-bbbe-44d7-aafe-a3be63cb9a02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:45.476110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90696-bbbe-44d7-aafe-a3be63cb9a02 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:45.476394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90696-bbbe-44d7-aafe-a3be63cb9a02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:45.476707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b90696-bbbe-44d7-aafe-a3be63cb9a02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:45.499954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b90696-bbbe-44d7-aafe-a3be63cb9a02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:45.501936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b90696-bbbe-44d7-aafe-a3be63cb9a02 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:45.527122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1093/2164] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:45.550417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7662a7cb-c37f-4b12-b921-88b5c6fffa64 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:45.561656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:45.562301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:45.562574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:45.562896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] PATH_INFO: `/v3/projects/e0643ea7bd8e469d894f669e5ededd76` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:45.565196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0643ea7bd8e469d894f669e5ededd76)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:45.567822 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:45.654180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0643ea7bd8e469d894f669e5ededd76', 'request_id': 'req-87c09070-a8b3-44f1-af87-a3f70f657295'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:45.666737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0643ea7bd8e469d894f669e5ededd76', 'request_id': 'req-87c09070-a8b3-44f1-af87-a3f70f657295'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:45.677923 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0643ea7bd8e469d894f669e5ededd76', 'request_id': 'req-87c09070-a8b3-44f1-af87-a3f70f657295'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:45.691923 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] The token cache is being invalidate because project e0643ea7bd8e469d894f669e5ededd76 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:07:45.692403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:45.693266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-87c09070-a8b3-44f1-af87-a3f70f657295 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:07:45.695227 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1072/2165] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:07:45 2022] DELETE /identity/v3/projects/e0643ea7bd8e469d894f669e5ededd76 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:45.700848 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdd2b7-f73d-491c-974f-fa1df43922aa None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:45.701166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdd2b7-f73d-491c-974f-fa1df43922aa None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:45.701436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bdd2b7-f73d-491c-974f-fa1df43922aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:45.748872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-e6bdd2b7-f73d-491c-974f-fa1df43922aa None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:45.750065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e6bdd2b7-f73d-491c-974f-fa1df43922aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:45.878755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1094/2166] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:45.888190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c801-7331-4688-8679-e30f46ae226a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:45.888732 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c801-7331-4688-8679-e30f46ae226a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:45.889148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95c801-7331-4688-8679-e30f46ae226a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:45.960900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3d95c801-7331-4688-8679-e30f46ae226a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:45.965711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3d95c801-7331-4688-8679-e30f46ae226a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:45.980795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1073/2167] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:45.985350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdd2b7-f73d-491c-974f-fa1df43922aa None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:46.006925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bdd2b7-f73d-491c-974f-fa1df43922aa None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:46.020197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ebf79-c627-4708-bbc2-61b1c0c2b63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:46.020856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ebf79-c627-4708-bbc2-61b1c0c2b63a admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:46.021136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ebf79-c627-4708-bbc2-61b1c0c2b63a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:46.021608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5ebf79-c627-4708-bbc2-61b1c0c2b63a admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:46.022233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ebf79-c627-4708-bbc2-61b1c0c2b63a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:07:46.022487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ebf79-c627-4708-bbc2-61b1c0c2b63a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:46.024150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5ebf79-c627-4708-bbc2-61b1c0c2b63a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:46.062243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1095/2168] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:07:46.068409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c801-7331-4688-8679-e30f46ae226a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:46.078723 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95c801-7331-4688-8679-e30f46ae226a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:46.085522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ecc86-e6eb-4634-874c-98c2efb8d97f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:46.086181 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ecc86-e6eb-4634-874c-98c2efb8d97f admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:46.086463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ecc86-e6eb-4634-874c-98c2efb8d97f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:46.086734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5ecc86-e6eb-4634-874c-98c2efb8d97f admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:46.087407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ecc86-e6eb-4634-874c-98c2efb8d97f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:46.089339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5ecc86-e6eb-4634-874c-98c2efb8d97f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:46.131756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1074/2169] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:46 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:46.136365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ebf79-c627-4708-bbc2-61b1c0c2b63a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:46.151909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5ebf79-c627-4708-bbc2-61b1c0c2b63a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:46.213055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:46.231843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e2a06-b6f4-4577-8295-9b8c354b878c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:46.232628 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e2a06-b6f4-4577-8295-9b8c354b878c admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:46.233014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e2a06-b6f4-4577-8295-9b8c354b878c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:46.233377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6e2a06-b6f4-4577-8295-9b8c354b878c admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:46.234105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e2a06-b6f4-4577-8295-9b8c354b878c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:46.236283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6e2a06-b6f4-4577-8295-9b8c354b878c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:46.265479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1096/2170] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:46 2022] POST /identity/v3/users => generated 293 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:46.270760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ecc86-e6eb-4634-874c-98c2efb8d97f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:46.285037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5ecc86-e6eb-4634-874c-98c2efb8d97f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:46.290631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd8096-901e-41e5-8125-b053ee302e82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:46.291345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd8096-901e-41e5-8125-b053ee302e82 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:46.291627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd8096-901e-41e5-8125-b053ee302e82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:46.291903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbd8096-901e-41e5-8125-b053ee302e82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:46.292589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd8096-901e-41e5-8125-b053ee302e82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:46.294229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbd8096-901e-41e5-8125-b053ee302e82 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:46.309608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1075/2171] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:46.310898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e2a06-b6f4-4577-8295-9b8c354b878c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:46.322325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6e2a06-b6f4-4577-8295-9b8c354b878c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:46.327707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cec46a-be1c-49b6-876d-71a12396179d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:46.328355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cec46a-be1c-49b6-876d-71a12396179d admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:46.328785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cec46a-be1c-49b6-876d-71a12396179d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:46.329062 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cec46a-be1c-49b6-876d-71a12396179d admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:46.329830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cec46a-be1c-49b6-876d-71a12396179d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:46.331556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cec46a-be1c-49b6-876d-71a12396179d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:46.347288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1097/2172] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:46.349158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd8096-901e-41e5-8125-b053ee302e82 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:46.360716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbd8096-901e-41e5-8125-b053ee302e82 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:46.367134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b69506-7769-48bb-bfb0-315b47fe505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:46.367867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b69506-7769-48bb-bfb0-315b47fe505f admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:46.368148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b69506-7769-48bb-bfb0-315b47fe505f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:46.368412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b69506-7769-48bb-bfb0-315b47fe505f admin admin] PATH_INFO: `/v3/projects/416da6ea029742d4be97ac818964fac8/users/d85456c1ecdd4286b3861d3c9d650f28/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:46.391051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b69506-7769-48bb-bfb0-315b47fe505f admin admin] RBAC: Authorizing `identity:create_grant(project_id=416da6ea029742d4be97ac818964fac8, user_id=d85456c1ecdd4286b3861d3c9d650f28, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:46.394722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b69506-7769-48bb-bfb0-315b47fe505f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:46.413796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1076/2173] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:46 2022] PUT /identity/v3/projects/416da6ea029742d4be97ac818964fac8/users/d85456c1ecdd4286b3861d3c9d650f28/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:46.418629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e782-b317-4af6-a5c9-e66732587110 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:46.419050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e782-b317-4af6-a5c9-e66732587110 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:46.419467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56e782-b317-4af6-a5c9-e66732587110 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:46.440853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ff56e782-b317-4af6-a5c9-e66732587110 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:46.442309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ff56e782-b317-4af6-a5c9-e66732587110 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:46.523918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1098/2174] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:46.534968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b69506-7769-48bb-bfb0-315b47fe505f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:46.540214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-87b69506-7769-48bb-bfb0-315b47fe505f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:46.588403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:46.625519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b69506-7769-48bb-bfb0-315b47fe505f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:46.629764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c04749-504b-4870-8dd2-d31983a46537 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:46.630532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c04749-504b-4870-8dd2-d31983a46537 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:46.630906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c04749-504b-4870-8dd2-d31983a46537 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:46.631238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c04749-504b-4870-8dd2-d31983a46537 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:46.641374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c04749-504b-4870-8dd2-d31983a46537 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:46.643754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c04749-504b-4870-8dd2-d31983a46537 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:46.656896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1077/2175] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:07:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:07:47.101363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6d4cd-5a30-40d0-bfcd-ac37050421e9 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:47.101931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6d4cd-5a30-40d0-bfcd-ac37050421e9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:47.102380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee6d4cd-5a30-40d0-bfcd-ac37050421e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:47.129550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-1ee6d4cd-5a30-40d0-bfcd-ac37050421e9 None None] MFA Rules not processed for user `a1ca7baf9ac94d7fa1da9a9327316ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:47.131113 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-1ee6d4cd-5a30-40d0-bfcd-ac37050421e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:47.234034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1099/2176] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:47 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:07:49.334804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db949-fef4-44a8-960e-013c39fd1041 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:49.335404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db949-fef4-44a8-960e-013c39fd1041 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:49.335511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0db949-fef4-44a8-960e-013c39fd1041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:49.366510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-de0db949-fef4-44a8-960e-013c39fd1041 None None] MFA Rules not processed for user `bfe3817d4e7241e689e6ecc095e938ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:49.367838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-de0db949-fef4-44a8-960e-013c39fd1041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:49.441327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1078/2177] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:49.447998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6d4cd-5a30-40d0-bfcd-ac37050421e9 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:49.451636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-1ee6d4cd-5a30-40d0-bfcd-ac37050421e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:49.474382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee6d4cd-5a30-40d0-bfcd-ac37050421e9 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:49.479916 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6d322-b5b3-4b89-9d71-5b0eb0c5cd17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:49.481029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6d322-b5b3-4b89-9d71-5b0eb0c5cd17 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:49.481029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6d322-b5b3-4b89-9d71-5b0eb0c5cd17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:49.481264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6d322-b5b3-4b89-9d71-5b0eb0c5cd17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:49.481872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6d322-b5b3-4b89-9d71-5b0eb0c5cd17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:49.483859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6d322-b5b3-4b89-9d71-5b0eb0c5cd17 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:49.524614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1100/2178] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:49 2022] POST /identity/v3/projects => generated 377 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:07:49.529997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0db949-fef4-44a8-960e-013c39fd1041 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:49.543313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0db949-fef4-44a8-960e-013c39fd1041 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:49.626430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8435d2-1ecf-4ff5-b36b-12c61d623393 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:49.627087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8435d2-1ecf-4ff5-b36b-12c61d623393 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:49.627390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8435d2-1ecf-4ff5-b36b-12c61d623393 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:49.627845 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8435d2-1ecf-4ff5-b36b-12c61d623393 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:49.628528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8435d2-1ecf-4ff5-b36b-12c61d623393 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:49.630787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8435d2-1ecf-4ff5-b36b-12c61d623393 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:49.697920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6d322-b5b3-4b89-9d71-5b0eb0c5cd17 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:49.698655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1079/2179] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:49 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:49.716404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6d322-b5b3-4b89-9d71-5b0eb0c5cd17 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:49.730680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc0b1b-2eca-47dd-86a5-84d0c2226f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:49.731565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc0b1b-2eca-47dd-86a5-84d0c2226f18 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:49.732169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc0b1b-2eca-47dd-86a5-84d0c2226f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:49.732870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc0b1b-2eca-47dd-86a5-84d0c2226f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:49.735757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc0b1b-2eca-47dd-86a5-84d0c2226f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:49.738542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc0b1b-2eca-47dd-86a5-84d0c2226f18 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:49.793669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8435d2-1ecf-4ff5-b36b-12c61d623393 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:49.796235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1101/2180] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:49.812597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8435d2-1ecf-4ff5-b36b-12c61d623393 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:49.822284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba60723-ff22-4f4e-a2ea-0d37ca0f4639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:49.823801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60723-ff22-4f4e-a2ea-0d37ca0f4639 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:49.826216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60723-ff22-4f4e-a2ea-0d37ca0f4639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:49.827233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba60723-ff22-4f4e-a2ea-0d37ca0f4639 admin admin] PATH_INFO: `/v3/projects/4a71f281cc384b0280e9165ec8d59d34/users/e1ef01e683554fad9e72130fbfcbddce/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:49.859634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba60723-ff22-4f4e-a2ea-0d37ca0f4639 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a71f281cc384b0280e9165ec8d59d34, user_id=e1ef01e683554fad9e72130fbfcbddce, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:49.865668 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba60723-ff22-4f4e-a2ea-0d37ca0f4639 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:49.886820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1080/2181] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:49 2022] PUT /identity/v3/projects/4a71f281cc384b0280e9165ec8d59d34/users/e1ef01e683554fad9e72130fbfcbddce/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:49.891443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc0b1b-2eca-47dd-86a5-84d0c2226f18 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:49.907144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc0b1b-2eca-47dd-86a5-84d0c2226f18 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:49.958319 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:50.087911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b653cef-2d9c-4395-888f-ef0a2e8f5fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:50.089860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653cef-2d9c-4395-888f-ef0a2e8f5fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:50.091301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653cef-2d9c-4395-888f-ef0a2e8f5fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:50.091762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b653cef-2d9c-4395-888f-ef0a2e8f5fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:50.094361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b653cef-2d9c-4395-888f-ef0a2e8f5fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:50.098755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b653cef-2d9c-4395-888f-ef0a2e8f5fa4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:50.161671 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1102/2182] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:49 2022] GET /identity/v3/roles => generated 1420 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:50.165989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba60723-ff22-4f4e-a2ea-0d37ca0f4639 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:50.179961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba60723-ff22-4f4e-a2ea-0d37ca0f4639 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:50.185402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7eedd-7f4e-4116-89ab-b3c41472f22e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:50.186261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7eedd-7f4e-4116-89ab-b3c41472f22e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:50.186885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7eedd-7f4e-4116-89ab-b3c41472f22e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:50.206992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c7eedd-7f4e-4116-89ab-b3c41472f22e admin admin] PATH_INFO: `/v3/projects/4a71f281cc384b0280e9165ec8d59d34/users/e1ef01e683554fad9e72130fbfcbddce/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:50.209727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7eedd-7f4e-4116-89ab-b3c41472f22e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4a71f281cc384b0280e9165ec8d59d34, user_id=e1ef01e683554fad9e72130fbfcbddce, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:50.212997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c7eedd-7f4e-4116-89ab-b3c41472f22e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:50.232577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1081/2183] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:50 2022] PUT /identity/v3/projects/4a71f281cc384b0280e9165ec8d59d34/users/e1ef01e683554fad9e72130fbfcbddce/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:53.653094 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b4db-4dc5-468b-98b0-856b70c85b60 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:53.653612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b4db-4dc5-468b-98b0-856b70c85b60 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:53.654560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464b4db-4dc5-468b-98b0-856b70c85b60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:53.715306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-0464b4db-4dc5-468b-98b0-856b70c85b60 None None] MFA Rules not processed for user `d85456c1ecdd4286b3861d3c9d650f28`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:07:53.716787 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0464b4db-4dc5-468b-98b0-856b70c85b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:07:53.842973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1103/2184] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:07:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:07:53.844940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7eedd-7f4e-4116-89ab-b3c41472f22e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:53.891984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:07:53.958442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c7eedd-7f4e-4116-89ab-b3c41472f22e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:53.965354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffa95a-00f1-4301-bcb4-4e330670bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:53.966093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffa95a-00f1-4301-bcb4-4e330670bc7d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:53.966469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffa95a-00f1-4301-bcb4-4e330670bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:53.967174 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ffa95a-00f1-4301-bcb4-4e330670bc7d admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:53.967918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffa95a-00f1-4301-bcb4-4e330670bc7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:53.970308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ffa95a-00f1-4301-bcb4-4e330670bc7d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:54.025657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1082/2185] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:07:53 2022] POST /identity/v3/projects => generated 385 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:54.027056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b4db-4dc5-468b-98b0-856b70c85b60 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:54.049307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464b4db-4dc5-468b-98b0-856b70c85b60 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:54.188135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40a2a8-46fa-4c98-b585-a91a31f1caf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:54.188788 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40a2a8-46fa-4c98-b585-a91a31f1caf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:54.189072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40a2a8-46fa-4c98-b585-a91a31f1caf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:54.189347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c40a2a8-46fa-4c98-b585-a91a31f1caf1 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:54.190045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40a2a8-46fa-4c98-b585-a91a31f1caf1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:54.192072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c40a2a8-46fa-4c98-b585-a91a31f1caf1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:54.237945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1104/2186] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:07:54 2022] POST /identity/v3/users => generated 299 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:07:54.243805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffa95a-00f1-4301-bcb4-4e330670bc7d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:54.276235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ffa95a-00f1-4301-bcb4-4e330670bc7d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:54.292279 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dd831-2480-4307-8d50-61855d8dd502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:54.294970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dd831-2480-4307-8d50-61855d8dd502 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:54.295274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dd831-2480-4307-8d50-61855d8dd502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:54.295555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740dd831-2480-4307-8d50-61855d8dd502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:54.297405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dd831-2480-4307-8d50-61855d8dd502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:54.305295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740dd831-2480-4307-8d50-61855d8dd502 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:54.329419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1083/2187] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:07:54.336119 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40a2a8-46fa-4c98-b585-a91a31f1caf1 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:54.369535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c40a2a8-46fa-4c98-b585-a91a31f1caf1 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:54.392596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810682ce-c242-463b-9911-0a4f34644f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:54.395255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810682ce-c242-463b-9911-0a4f34644f49 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:54.395512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810682ce-c242-463b-9911-0a4f34644f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:54.396448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810682ce-c242-463b-9911-0a4f34644f49 admin admin] PATH_INFO: `/v3/projects/39183b890d1d48bf98c3784dacba2676/users/d56eb2bc21554244864f787b12eee84a/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:54.463238 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810682ce-c242-463b-9911-0a4f34644f49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39183b890d1d48bf98c3784dacba2676, user_id=d56eb2bc21554244864f787b12eee84a, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:54.473835 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810682ce-c242-463b-9911-0a4f34644f49 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:54.513653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1105/2188] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:54 2022] PUT /identity/v3/projects/39183b890d1d48bf98c3784dacba2676/users/d56eb2bc21554244864f787b12eee84a/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:07:54.517261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dd831-2480-4307-8d50-61855d8dd502 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:54.533798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740dd831-2480-4307-8d50-61855d8dd502 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:54.799206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25e56ff-8728-4c1e-b06c-11bb3b4105e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:54.800305 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e56ff-8728-4c1e-b06c-11bb3b4105e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:54.800582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e56ff-8728-4c1e-b06c-11bb3b4105e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:54.800852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25e56ff-8728-4c1e-b06c-11bb3b4105e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:54.802041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e56ff-8728-4c1e-b06c-11bb3b4105e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:54.805436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25e56ff-8728-4c1e-b06c-11bb3b4105e7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:54.835007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1084/2189] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:07:54 2022] GET /identity/v3/roles => generated 1420 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:07:54.839350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810682ce-c242-463b-9911-0a4f34644f49 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:07:54.861854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810682ce-c242-463b-9911-0a4f34644f49 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:07:54.874638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34634c2-6582-4e1d-80ec-d5b2d8444e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:07:54.875429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34634c2-6582-4e1d-80ec-d5b2d8444e4b admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:07:54.876724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34634c2-6582-4e1d-80ec-d5b2d8444e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:07:54.876724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34634c2-6582-4e1d-80ec-d5b2d8444e4b admin admin] PATH_INFO: `/v3/projects/39183b890d1d48bf98c3784dacba2676/users/d56eb2bc21554244864f787b12eee84a/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:07:54.897425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34634c2-6582-4e1d-80ec-d5b2d8444e4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=39183b890d1d48bf98c3784dacba2676, user_id=d56eb2bc21554244864f787b12eee84a, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:07:54.897425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34634c2-6582-4e1d-80ec-d5b2d8444e4b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:07:54.909964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1106/2190] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:07:54 2022] PUT /identity/v3/projects/39183b890d1d48bf98c3784dacba2676/users/d56eb2bc21554244864f787b12eee84a/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:08:01.678983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d7da2-4aa1-402d-ac62-17c57c773ad6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:01.679565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d7da2-4aa1-402d-ac62-17c57c773ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:01.679565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d7da2-4aa1-402d-ac62-17c57c773ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:01.779763 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c98d7da2-4aa1-402d-ac62-17c57c773ad6 None None] MFA Rules not processed for user `e1ef01e683554fad9e72130fbfcbddce`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:01.781022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c98d7da2-4aa1-402d-ac62-17c57c773ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:02.003878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1085/2191] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:08:01 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:02.016886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34634c2-6582-4e1d-80ec-d5b2d8444e4b admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:02.022702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e34634c2-6582-4e1d-80ec-d5b2d8444e4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:02.084353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:02.258754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34634c2-6582-4e1d-80ec-d5b2d8444e4b admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:02.270843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a88d81-8496-48e4-8ca1-6d445405f4b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:02.271839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a88d81-8496-48e4-8ca1-6d445405f4b3 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:02.272286 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a88d81-8496-48e4-8ca1-6d445405f4b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:02.274976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a88d81-8496-48e4-8ca1-6d445405f4b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:02.435848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7052c9-0aab-4138-9cee-35e463b12a78 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:02.436152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7052c9-0aab-4138-9cee-35e463b12a78 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:02.437593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7052c9-0aab-4138-9cee-35e463b12a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:02.473559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a88d81-8496-48e4-8ca1-6d445405f4b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:02.475893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a88d81-8496-48e4-8ca1-6d445405f4b3 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:02.489959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:02.510569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5a7052c9-0aab-4138-9cee-35e463b12a78 None None] MFA Rules not processed for user `d56eb2bc21554244864f787b12eee84a`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:02.512604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5a7052c9-0aab-4138-9cee-35e463b12a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:02.512779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1107/2192] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:02 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:08:02.682129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1086/2193] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:08:02 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:02.704939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a88d81-8496-48e4-8ca1-6d445405f4b3 service nova] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:02.706514 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-74a88d81-8496-48e4-8ca1-6d445405f4b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:02.841666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a88d81-8496-48e4-8ca1-6d445405f4b3 service nova] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:02.846471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3390a-8f6e-438b-a578-506ddf2e0402 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7074acac73904bab8399f223bd662863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:02.846732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3390a-8f6e-438b-a578-506ddf2e0402 service glance] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:02.847348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3390a-8f6e-438b-a578-506ddf2e0402 service glance] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:02.847541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3390a-8f6e-438b-a578-506ddf2e0402 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:02.973600 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3390a-8f6e-438b-a578-506ddf2e0402 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:02.975598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3390a-8f6e-438b-a578-506ddf2e0402 service glance] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:03.007891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1108/2194] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:02 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:08:03.350694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e638-d8e3-4e64-8f5e-9ccc9a6303c3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:03.352338 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e638-d8e3-4e64-8f5e-9ccc9a6303c3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:03.352819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b681e638-d8e3-4e64-8f5e-9ccc9a6303c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:03.395611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b681e638-d8e3-4e64-8f5e-9ccc9a6303c3 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:03.397136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b681e638-d8e3-4e64-8f5e-9ccc9a6303c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:03.481715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1087/2195] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:08:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:03.550012 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3390a-8f6e-438b-a578-506ddf2e0402 service glance] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:03.551979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-fbd3390a-8f6e-438b-a578-506ddf2e0402 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:03.573803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:03.685690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3390a-8f6e-438b-a578-506ddf2e0402 service glance] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:03.697817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22952d7-098c-40be-9bc8-990457efebcf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:03.698582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22952d7-098c-40be-9bc8-990457efebcf service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:03.698900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22952d7-098c-40be-9bc8-990457efebcf service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:03.699174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22952d7-098c-40be-9bc8-990457efebcf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:03.711803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22952d7-098c-40be-9bc8-990457efebcf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:03.713541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22952d7-098c-40be-9bc8-990457efebcf service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:03.733143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1109/2196] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:08:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:08:06.320068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d9eb-d2fa-429b-b6f1-98c665339c6a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:06.321850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d9eb-d2fa-429b-b6f1-98c665339c6a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:06.322573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed85d9eb-d2fa-429b-b6f1-98c665339c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:06.382392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ed85d9eb-d2fa-429b-b6f1-98c665339c6a None None] MFA Rules not processed for user `b9277840830b454c9097109a45d48927`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:06.383750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ed85d9eb-d2fa-429b-b6f1-98c665339c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:06.461688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1088/2197] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:08:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:13.720203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=29 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:16.453933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=79 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:17.258697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281c34-835e-4d04-8992-b249d519cbd7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:17.259442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281c34-835e-4d04-8992-b249d519cbd7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:17.259442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1281c34-835e-4d04-8992-b249d519cbd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:17.280018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-e1281c34-835e-4d04-8992-b249d519cbd7 None None] MFA Rules not processed for user `d85456c1ecdd4286b3861d3c9d650f28`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:17.281296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e1281c34-835e-4d04-8992-b249d519cbd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:17.288549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1110/2198] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:08:17 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:23.697042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daf852-52c5-4083-a38e-af66e720ceb5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:23.697639 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daf852-52c5-4083-a38e-af66e720ceb5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:23.697639 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46daf852-52c5-4083-a38e-af66e720ceb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:23.729417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-46daf852-52c5-4083-a38e-af66e720ceb5 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:23.731445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-46daf852-52c5-4083-a38e-af66e720ceb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:23.742796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1089/2199] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:08:23 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:23.757683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281c34-835e-4d04-8992-b249d519cbd7 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:23.771695 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1281c34-835e-4d04-8992-b249d519cbd7 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:23.779154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057335f6-ddd2-4455-a8f6-b125e22eae97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:23.780031 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057335f6-ddd2-4455-a8f6-b125e22eae97 service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:23.780480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057335f6-ddd2-4455-a8f6-b125e22eae97 service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:23.780914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057335f6-ddd2-4455-a8f6-b125e22eae97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:23.791278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057335f6-ddd2-4455-a8f6-b125e22eae97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:23.792903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057335f6-ddd2-4455-a8f6-b125e22eae97 service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:23.803660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1111/2200] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:08:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:08:25.698158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea0f82-55e1-432c-9dff-837797fcf7e2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:25.698836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea0f82-55e1-432c-9dff-837797fcf7e2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:25.698836 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccea0f82-55e1-432c-9dff-837797fcf7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:25.718158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ccea0f82-55e1-432c-9dff-837797fcf7e2 None None] MFA Rules not processed for user `dda19c20bfec49b8b9e1d589f7e3e188`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:25.719419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ccea0f82-55e1-432c-9dff-837797fcf7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:25.778363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1090/2201] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:08:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:30.024838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c417e-0f9b-4531-ad95-32aa70862aeb None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:30.025722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c417e-0f9b-4531-ad95-32aa70862aeb None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:30.025722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966c417e-0f9b-4531-ad95-32aa70862aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:30.046006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-966c417e-0f9b-4531-ad95-32aa70862aeb None None] MFA Rules not processed for user `bfe3817d4e7241e689e6ecc095e938ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:30.047270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-966c417e-0f9b-4531-ad95-32aa70862aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:30.054513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1112/2202] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:08:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:35.776101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=28 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:40.041219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=12 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:40.748166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209bc60-fd7f-41c2-a792-520519ae4e3e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:40.749866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209bc60-fd7f-41c2-a792-520519ae4e3e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:40.750150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209bc60-fd7f-41c2-a792-520519ae4e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:40.785905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8209bc60-fd7f-41c2-a792-520519ae4e3e None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:40.788179 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8209bc60-fd7f-41c2-a792-520519ae4e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:40.796776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1091/2203] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:08:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:40.814613 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c417e-0f9b-4531-ad95-32aa70862aeb None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:40.833059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966c417e-0f9b-4531-ad95-32aa70862aeb None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:40.840741 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f7383-8a6a-4c4d-a538-647ae55f1357 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:40.841607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7383-8a6a-4c4d-a538-647ae55f1357 service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:40.842094 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7383-8a6a-4c4d-a538-647ae55f1357 service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:40.842570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181f7383-8a6a-4c4d-a538-647ae55f1357 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:40.856129 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f7383-8a6a-4c4d-a538-647ae55f1357 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:40.858195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181f7383-8a6a-4c4d-a538-647ae55f1357 service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:40.876523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1113/2204] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:08:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:08:41.580693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb942090-e03b-4eb7-bba9-24b1d98f2109 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:41.581116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb942090-e03b-4eb7-bba9-24b1d98f2109 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:41.581557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb942090-e03b-4eb7-bba9-24b1d98f2109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:41.602612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-eb942090-e03b-4eb7-bba9-24b1d98f2109 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:41.604025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-eb942090-e03b-4eb7-bba9-24b1d98f2109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:41.611935 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1092/2205] 10.222.0.59 () {58 vars in 967 bytes} [Thu Aug 18 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:08:41.627213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f7383-8a6a-4c4d-a538-647ae55f1357 service swift] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:41.639722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181f7383-8a6a-4c4d-a538-647ae55f1357 service swift] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:41.646449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ecc1a-6ebb-4efa-aea4-d99b24c343ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:41.647367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ecc1a-6ebb-4efa-aea4-d99b24c343ba service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:41.647833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ecc1a-6ebb-4efa-aea4-d99b24c343ba service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:41.648108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ecc1a-6ebb-4efa-aea4-d99b24c343ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:41.658164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ecc1a-6ebb-4efa-aea4-d99b24c343ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:41.660624 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ecc1a-6ebb-4efa-aea4-d99b24c343ba service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:41.671073 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1114/2206] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:08:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:08:41.944261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173f177-e7cc-4204-8630-0dc30d6a6cae None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:41.945498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173f177-e7cc-4204-8630-0dc30d6a6cae None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:41.945773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b173f177-e7cc-4204-8630-0dc30d6a6cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:41.966465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b173f177-e7cc-4204-8630-0dc30d6a6cae None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:41.967778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b173f177-e7cc-4204-8630-0dc30d6a6cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:41.975943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1093/2207] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:08:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:41.988702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ecc1a-6ebb-4efa-aea4-d99b24c343ba service swift] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:41.999641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ecc1a-6ebb-4efa-aea4-d99b24c343ba service swift] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:42.005310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222389c-7a7c-4788-ae07-97395d37999d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:42.006045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222389c-7a7c-4788-ae07-97395d37999d service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:42.006381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222389c-7a7c-4788-ae07-97395d37999d service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:42.006684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4222389c-7a7c-4788-ae07-97395d37999d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:42.018359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222389c-7a7c-4788-ae07-97395d37999d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:42.022150 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4222389c-7a7c-4788-ae07-97395d37999d service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:42.057587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1115/2208] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:08:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 21:08:42.606394 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78490241-eeb6-4727-9277-1039f9f08cbf None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:42.606675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78490241-eeb6-4727-9277-1039f9f08cbf None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:42.606997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78490241-eeb6-4727-9277-1039f9f08cbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:42.640498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-78490241-eeb6-4727-9277-1039f9f08cbf None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:42.641921 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-78490241-eeb6-4727-9277-1039f9f08cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:42.651084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1094/2209] 10.222.0.59 () {58 vars in 967 bytes} [Thu Aug 18 21:08:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:08:42.670500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222389c-7a7c-4788-ae07-97395d37999d service swift] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:42.681507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4222389c-7a7c-4788-ae07-97395d37999d service swift] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:42.690170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba283df3-699e-4cba-a904-d0756594664b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:42.690866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283df3-699e-4cba-a904-d0756594664b service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:42.691830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283df3-699e-4cba-a904-d0756594664b service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:42.692527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba283df3-699e-4cba-a904-d0756594664b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:42.707797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba283df3-699e-4cba-a904-d0756594664b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:42.709443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba283df3-699e-4cba-a904-d0756594664b service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:42.719214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1116/2210] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:08:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:08:45.004292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78490241-eeb6-4727-9277-1039f9f08cbf None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:45.005983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-78490241-eeb6-4727-9277-1039f9f08cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:45.085723 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78490241-eeb6-4727-9277-1039f9f08cbf None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:45.091074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:45.091710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:45.091987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:45.092259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] PATH_INFO: `/v3/users/a1ca7baf9ac94d7fa1da9a9327316ca4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:45.094506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1ca7baf9ac94d7fa1da9a9327316ca4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:45.096941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:45.165356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1ca7baf9ac94d7fa1da9a9327316ca4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:08:45.166041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1ca7baf9ac94d7fa1da9a9327316ca4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:08:45.166654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1ca7baf9ac94d7fa1da9a9327316ca4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:08:45.179832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1ca7baf9ac94d7fa1da9a9327316ca4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:08:45.188972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1ca7baf9ac94d7fa1da9a9327316ca4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:08:45.203759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1095/2211] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:08:45 2022] DELETE /identity/v3/users/a1ca7baf9ac94d7fa1da9a9327316ca4 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:08:45.208489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91d593-8c18-440e-b60f-2552823a7809 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:45.209302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91d593-8c18-440e-b60f-2552823a7809 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:45.209722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c91d593-8c18-440e-b60f-2552823a7809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:45.231674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-6c91d593-8c18-440e-b60f-2552823a7809 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:08:45.232911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6c91d593-8c18-440e-b60f-2552823a7809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:45.296944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1117/2212] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:08:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:08:45.308975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:45.310427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:45.370189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bfc4dd1-0741-4518-b867-bc0cdb0eb9fd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:45.373991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c587edf-40a5-4c63-9879-c6b28fdacd19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:45.374602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c587edf-40a5-4c63-9879-c6b28fdacd19 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:45.374911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c587edf-40a5-4c63-9879-c6b28fdacd19 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:45.375207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c587edf-40a5-4c63-9879-c6b28fdacd19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:45.383563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:45.396374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c587edf-40a5-4c63-9879-c6b28fdacd19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:45.398031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c587edf-40a5-4c63-9879-c6b28fdacd19 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:45.410005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1096/2213] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:08:45.642428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91d593-8c18-440e-b60f-2552823a7809 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:45.644957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6c91d593-8c18-440e-b60f-2552823a7809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:45.663235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c91d593-8c18-440e-b60f-2552823a7809 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:45.670322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:45.671573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:45.672121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:45.672538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] PATH_INFO: `/v3/projects/417f24e161274e708c3c0028f65f14b9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:45.674036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] RBAC: Authorizing `identity:delete_project(project_id=417f24e161274e708c3c0028f65f14b9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:45.676801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:45.756069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '417f24e161274e708c3c0028f65f14b9', 'request_id': 'req-36e1916b-fa9c-4cc7-b573-78156591843b'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:08:45.763644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '417f24e161274e708c3c0028f65f14b9', 'request_id': 'req-36e1916b-fa9c-4cc7-b573-78156591843b'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:08:45.774246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c587edf-40a5-4c63-9879-c6b28fdacd19 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:08:45.775969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3c587edf-40a5-4c63-9879-c6b28fdacd19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:45.797093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '417f24e161274e708c3c0028f65f14b9', 'request_id': 'req-36e1916b-fa9c-4cc7-b573-78156591843b'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:08:45.825457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] The token cache is being invalidate because project 417f24e161274e708c3c0028f65f14b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:08:45.825790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:08:45.826519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-36e1916b-fa9c-4cc7-b573-78156591843b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:08:45.828868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1118/2214] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:08:45 2022] DELETE /identity/v3/projects/417f24e161274e708c3c0028f65f14b9 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:08:45.895599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c587edf-40a5-4c63-9879-c6b28fdacd19 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:08:45.975361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f21554-695c-470a-bae1-498f019fd33b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:08:45.976069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f21554-695c-470a-bae1-498f019fd33b service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:08:45.976387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f21554-695c-470a-bae1-498f019fd33b service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:08:45.976654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f21554-695c-470a-bae1-498f019fd33b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:08:45.978667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c1f21554-695c-470a-bae1-498f019fd33b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:08:45.991266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f21554-695c-470a-bae1-498f019fd33b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:08:45.992903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f21554-695c-470a-bae1-498f019fd33b service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:08:46.004970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1097/2215] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:08:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:08:55.816925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:08:55.999951 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=60 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:00.195901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804209-8898-4d70-8448-fc4df952a3c7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:00.196416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804209-8898-4d70-8448-fc4df952a3c7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:00.196506 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0804209-8898-4d70-8448-fc4df952a3c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:00.227254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-e0804209-8898-4d70-8448-fc4df952a3c7 None None] MFA Rules not processed for user `c484e6ecc6af477e851979a130a69cfc`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:00.228472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e0804209-8898-4d70-8448-fc4df952a3c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:00.291339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1119/2216] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:09:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:10.283609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=25 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:11.168578 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f21554-695c-470a-bae1-498f019fd33b service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:11.170078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c1f21554-695c-470a-bae1-498f019fd33b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:11.229980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f21554-695c-470a-bae1-498f019fd33b service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:11.233899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe38f55-45f9-4cd7-950a-2b0683864052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:11.234530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe38f55-45f9-4cd7-950a-2b0683864052 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:11.234819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe38f55-45f9-4cd7-950a-2b0683864052 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:11.235095 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe38f55-45f9-4cd7-950a-2b0683864052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:11.236928 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ffe38f55-45f9-4cd7-950a-2b0683864052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:11.287126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804209-8898-4d70-8448-fc4df952a3c7 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:11.297218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0804209-8898-4d70-8448-fc4df952a3c7 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:11.300989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6cc70-35b8-48bb-a828-b166d2dbf3b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:11.301638 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6cc70-35b8-48bb-a828-b166d2dbf3b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:11.301918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6cc70-35b8-48bb-a828-b166d2dbf3b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:11.302192 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6cc70-35b8-48bb-a828-b166d2dbf3b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:11.304342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-72b6cc70-35b8-48bb-a828-b166d2dbf3b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:11.306152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe38f55-45f9-4cd7-950a-2b0683864052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:11.307661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe38f55-45f9-4cd7-950a-2b0683864052 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:11.317293 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1098/2217] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:09:11.371092 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6cc70-35b8-48bb-a828-b166d2dbf3b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:11.372643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6cc70-35b8-48bb-a828-b166d2dbf3b2 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:11.383385 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1120/2218] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:11 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:09:20.029418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5e5c3-e357-489f-b5d7-af9328dac248 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:20.029954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5e5c3-e357-489f-b5d7-af9328dac248 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:20.030060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e5e5c3-e357-489f-b5d7-af9328dac248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:20.051112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-05e5e5c3-e357-489f-b5d7-af9328dac248 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:20.052364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-05e5e5c3-e357-489f-b5d7-af9328dac248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:20.112712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1099/2219] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:09:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:20.137419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6cc70-35b8-48bb-a828-b166d2dbf3b2 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:20.139133 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-72b6cc70-35b8-48bb-a828-b166d2dbf3b2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:20.218295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6cc70-35b8-48bb-a828-b166d2dbf3b2 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:20.223934 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe722b-b221-4609-ba51-9f43f0f3236f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:20.224414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe722b-b221-4609-ba51-9f43f0f3236f service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:20.224691 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe722b-b221-4609-ba51-9f43f0f3236f service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:20.225169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe722b-b221-4609-ba51-9f43f0f3236f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:20.234914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe722b-b221-4609-ba51-9f43f0f3236f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:20.236672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe722b-b221-4609-ba51-9f43f0f3236f service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:20.246281 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1121/2220] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:09:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:09:30.105752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=75 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:30.242736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=62 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:38.120901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30666a8-bb3c-40c0-ae36-495fb9a17214 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:38.121477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30666a8-bb3c-40c0-ae36-495fb9a17214 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:38.121477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30666a8-bb3c-40c0-ae36-495fb9a17214 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:38.122968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1100/2221] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 21:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:09:38.129134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b1d8d-39f0-4ff4-ab69-8c9867f1331a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:38.130562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b1d8d-39f0-4ff4-ab69-8c9867f1331a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:38.131509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99b1d8d-39f0-4ff4-ab69-8c9867f1331a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:38.155592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-b99b1d8d-39f0-4ff4-ab69-8c9867f1331a None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:38.156820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b99b1d8d-39f0-4ff4-ab69-8c9867f1331a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:38.237077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1122/2222] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:38.252366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30666a8-bb3c-40c0-ae36-495fb9a17214 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:38.254136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b30666a8-bb3c-40c0-ae36-495fb9a17214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:38.324954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30666a8-bb3c-40c0-ae36-495fb9a17214 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:38.328688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4979837b-14fc-4915-a7eb-8ff03f4647c8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7074acac73904bab8399f223bd662863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:38.329294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979837b-14fc-4915-a7eb-8ff03f4647c8 service glance] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:38.329567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979837b-14fc-4915-a7eb-8ff03f4647c8 service glance] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:38.329831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4979837b-14fc-4915-a7eb-8ff03f4647c8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:38.342024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979837b-14fc-4915-a7eb-8ff03f4647c8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:38.343495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4979837b-14fc-4915-a7eb-8ff03f4647c8 service glance] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:38.354184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1101/2223] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:09:38.428102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e644f00-c90f-4a45-969e-35d4a5e990b9 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:38.428393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e644f00-c90f-4a45-969e-35d4a5e990b9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:38.428715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e644f00-c90f-4a45-969e-35d4a5e990b9 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:38.430087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1123/2224] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 21:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:09:38.434909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51854a8e-4c11-4774-b8e1-5fd193614447 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:38.435195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51854a8e-4c11-4774-b8e1-5fd193614447 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:38.435468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51854a8e-4c11-4774-b8e1-5fd193614447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:38.455039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-51854a8e-4c11-4774-b8e1-5fd193614447 None None] MFA Rules not processed for user `309ebac21dd944029b1de80ba54dd794`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:38.456246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-51854a8e-4c11-4774-b8e1-5fd193614447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:38.463462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1102/2225] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:38.475387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e644f00-c90f-4a45-969e-35d4a5e990b9 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:38.477093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6e644f00-c90f-4a45-969e-35d4a5e990b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:38.490609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e644f00-c90f-4a45-969e-35d4a5e990b9 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:38.494425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157746d8-d668-41f5-8076-2d353ef059bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:38.495288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157746d8-d668-41f5-8076-2d353ef059bd service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:38.495559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157746d8-d668-41f5-8076-2d353ef059bd service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:38.495824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157746d8-d668-41f5-8076-2d353ef059bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:38.503116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157746d8-d668-41f5-8076-2d353ef059bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:38.504538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157746d8-d668-41f5-8076-2d353ef059bd service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:38.512640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1124/2226] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:38 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:09:38.617880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56320-dd77-44e7-b7d0-29a8f975515f None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:38.618168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56320-dd77-44e7-b7d0-29a8f975515f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:38.618438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be56320-dd77-44e7-b7d0-29a8f975515f None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:38.619860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1103/2227] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 21:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:09:38.625901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b9d2c-56e5-47cd-a260-2827dee4903b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:38.626188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b9d2c-56e5-47cd-a260-2827dee4903b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:38.626466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b9d2c-56e5-47cd-a260-2827dee4903b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:38.648713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-103b9d2c-56e5-47cd-a260-2827dee4903b None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:38.649978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-103b9d2c-56e5-47cd-a260-2827dee4903b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:38.664110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1125/2228] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 21:09:38 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:09:38.675639 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be56320-dd77-44e7-b7d0-29a8f975515f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:38.692194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be56320-dd77-44e7-b7d0-29a8f975515f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:38.697423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014851d-54b3-43af-a63e-558b385d2237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:38.698070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014851d-54b3-43af-a63e-558b385d2237 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:38.698374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014851d-54b3-43af-a63e-558b385d2237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:38.698651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4014851d-54b3-43af-a63e-558b385d2237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:38.712373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014851d-54b3-43af-a63e-558b385d2237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:38.713862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4014851d-54b3-43af-a63e-558b385d2237 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:38.725979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1104/2229] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:09:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:09:44.447296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f779c3-768c-4eda-84bd-221eaf8849bd None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:44.447776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f779c3-768c-4eda-84bd-221eaf8849bd None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:44.447888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f779c3-768c-4eda-84bd-221eaf8849bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:44.467240 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d9f779c3-768c-4eda-84bd-221eaf8849bd None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:09:44.468450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d9f779c3-768c-4eda-84bd-221eaf8849bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:09:44.476378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1126/2230] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:09:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:09:44.488557 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014851d-54b3-43af-a63e-558b385d2237 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:09:44.500117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4014851d-54b3-43af-a63e-558b385d2237 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:09:44.505329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e7eac-d436-4590-88d2-2b950e06e435 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:09:44.505975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e7eac-d436-4590-88d2-2b950e06e435 service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:09:44.506281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e7eac-d436-4590-88d2-2b950e06e435 service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:09:44.506552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e7eac-d436-4590-88d2-2b950e06e435 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:09:44.514988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e7eac-d436-4590-88d2-2b950e06e435 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:09:44.516578 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e7eac-d436-4590-88d2-2b950e06e435 service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:09:44.524967 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1105/2231] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:09:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 18 21:09:54.462273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=43 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:09:54.521792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=41 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:16.431230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98c188-c841-455a-be0f-d4e941360315 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:16.431760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98c188-c841-455a-be0f-d4e941360315 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:16.431760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb98c188-c841-455a-be0f-d4e941360315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:16.453135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-eb98c188-c841-455a-be0f-d4e941360315 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:16.454465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-eb98c188-c841-455a-be0f-d4e941360315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:16.468215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1127/2232] 10.222.0.59 () {58 vars in 967 bytes} [Thu Aug 18 21:10:16 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:10:16.481959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e7eac-d436-4590-88d2-2b950e06e435 service swift] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:16.493006 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e7eac-d436-4590-88d2-2b950e06e435 service swift] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:16.498812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad56f206-65f4-416b-b974-69fafeed3255 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:16.499555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56f206-65f4-416b-b974-69fafeed3255 service swift] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:16.499828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56f206-65f4-416b-b974-69fafeed3255 service swift] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:16.500094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad56f206-65f4-416b-b974-69fafeed3255 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:16.508888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56f206-65f4-416b-b974-69fafeed3255 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:16.510552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad56f206-65f4-416b-b974-69fafeed3255 service swift] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:16.520231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1106/2233] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:10:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:10:24.432822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf436342-dd25-42fc-b359-b2c16f936d4a None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:24.433344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf436342-dd25-42fc-b359-b2c16f936d4a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:24.433598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf436342-dd25-42fc-b359-b2c16f936d4a None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:24.435107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1128/2234] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 21:10:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:10:24.446544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01863c-5516-4e70-af65-e3a90f80a1c5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:24.447102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01863c-5516-4e70-af65-e3a90f80a1c5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:24.447102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b01863c-5516-4e70-af65-e3a90f80a1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:24.469556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-9b01863c-5516-4e70-af65-e3a90f80a1c5 None None] MFA Rules not processed for user `16a4ba52fe124009a570fd1408903cd3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:24.470845 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9b01863c-5516-4e70-af65-e3a90f80a1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:24.484367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1107/2235] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 21:10:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:10:24.496027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf436342-dd25-42fc-b359-b2c16f936d4a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:24.498684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-cf436342-dd25-42fc-b359-b2c16f936d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:24.516105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01863c-5516-4e70-af65-e3a90f80a1c5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:24.519877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-9b01863c-5516-4e70-af65-e3a90f80a1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:24.524400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf436342-dd25-42fc-b359-b2c16f936d4a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:24.532421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a2dc4-53dc-4540-948c-64f512843e83 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:24.533463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2dc4-53dc-4540-948c-64f512843e83 service placement] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:24.533742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2dc4-53dc-4540-948c-64f512843e83 service placement] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:24.534013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5a2dc4-53dc-4540-948c-64f512843e83 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:24.558219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a2dc4-53dc-4540-948c-64f512843e83 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:24.560095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5a2dc4-53dc-4540-948c-64f512843e83 service placement] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:24.575509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1129/2236] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:24.607257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b01863c-5516-4e70-af65-e3a90f80a1c5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:24.613042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:24.613817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:24.614186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:24.614551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] PATH_INFO: `/v3/users/c484e6ecc6af477e851979a130a69cfc` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:24.615831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c484e6ecc6af477e851979a130a69cfc)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:24.617850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:24.679917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c484e6ecc6af477e851979a130a69cfc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:10:24.680818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c484e6ecc6af477e851979a130a69cfc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:10:24.681459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c484e6ecc6af477e851979a130a69cfc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:10:24.695936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c484e6ecc6af477e851979a130a69cfc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:10:24.707860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c3228b1e-cf30-4832-9b4a-953cd51047d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c484e6ecc6af477e851979a130a69cfc'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:10:24.722273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1108/2237] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:10:24 2022] DELETE /identity/v3/users/c484e6ecc6af477e851979a130a69cfc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:10:24.900134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a2dc4-53dc-4540-948c-64f512843e83 service placement] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:24.912900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5a2dc4-53dc-4540-948c-64f512843e83 service placement] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:24.976650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:24.977265 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:24.977537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:24.977805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] PATH_INFO: `/v3/projects/4934527a57f049cfa123e8b33180f4f6` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:24.978955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4934527a57f049cfa123e8b33180f4f6)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:24.980883 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:25.034282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4934527a57f049cfa123e8b33180f4f6', 'request_id': 'req-702d261d-8702-439d-89c3-3be038b08b60'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:10:25.040010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4934527a57f049cfa123e8b33180f4f6', 'request_id': 'req-702d261d-8702-439d-89c3-3be038b08b60'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:10:25.049345 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4934527a57f049cfa123e8b33180f4f6', 'request_id': 'req-702d261d-8702-439d-89c3-3be038b08b60'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:10:25.061858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] The token cache is being invalidate because project 4934527a57f049cfa123e8b33180f4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:10:25.062158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:10:25.062943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:10:25.064542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1130/2238] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:10:24 2022] DELETE /identity/v3/projects/4934527a57f049cfa123e8b33180f4f6 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:10:27.422024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bffb3d-0a7a-4c14-8574-88968f17ddc0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:27.422701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bffb3d-0a7a-4c14-8574-88968f17ddc0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:27.422701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bffb3d-0a7a-4c14-8574-88968f17ddc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:27.446333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-40bffb3d-0a7a-4c14-8574-88968f17ddc0 None None] MFA Rules not processed for user `dda19c20bfec49b8b9e1d589f7e3e188`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:27.447605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-40bffb3d-0a7a-4c14-8574-88968f17ddc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:27.506838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1109/2239] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:10:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:10:33.604964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:33.606603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:33.673606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702d261d-8702-439d-89c3-3be038b08b60 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:33.678245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d94d8-83f2-46e0-8ad4-ceede60b4611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:33.678920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d94d8-83f2-46e0-8ad4-ceede60b4611 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:33.679198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d94d8-83f2-46e0-8ad4-ceede60b4611 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:33.679463 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d94d8-83f2-46e0-8ad4-ceede60b4611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:33.681625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f93d94d8-83f2-46e0-8ad4-ceede60b4611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:33.707646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:33.753392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d94d8-83f2-46e0-8ad4-ceede60b4611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:33.755083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d94d8-83f2-46e0-8ad4-ceede60b4611 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:33.766427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1131/2240] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:33.911875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35810528-020d-48d6-92b0-ba3c938b5d41 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:33.912368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35810528-020d-48d6-92b0-ba3c938b5d41 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:33.912474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35810528-020d-48d6-92b0-ba3c938b5d41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:33.920788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:33.932296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-35810528-020d-48d6-92b0-ba3c938b5d41 None None] MFA Rules not processed for user `b9277840830b454c9097109a45d48927`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:10:33.933888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-35810528-020d-48d6-92b0-ba3c938b5d41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:34.005871 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d94d8-83f2-46e0-8ad4-ceede60b4611 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:10:34.007626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f93d94d8-83f2-46e0-8ad4-ceede60b4611 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:34.008069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1110/2241] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:10:33 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:10:34.019284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d94d8-83f2-46e0-8ad4-ceede60b4611 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:10:34.023075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1610-9745-475a-8e44-f0f96852518d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:10:34.023852 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1610-9745-475a-8e44-f0f96852518d service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:10:34.024228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1610-9745-475a-8e44-f0f96852518d service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:10:34.024592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb1610-9745-475a-8e44-f0f96852518d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:10:34.026431 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4acb1610-9745-475a-8e44-f0f96852518d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:10:34.040802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb1610-9745-475a-8e44-f0f96852518d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:10:34.042249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acb1610-9745-475a-8e44-f0f96852518d service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:10:34.053829 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1132/2242] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:10:34 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:10:43.995908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=23 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:10:44.048802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=28 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:07.950197 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0fda-a913-478a-923a-4e3fb532bb75 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:07.950809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0fda-a913-478a-923a-4e3fb532bb75 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:07.950809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97e0fda-a913-478a-923a-4e3fb532bb75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:07.971237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d97e0fda-a913-478a-923a-4e3fb532bb75 None None] MFA Rules not processed for user `4774b2f6020b434595c578a738caccde`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:07.972441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d97e0fda-a913-478a-923a-4e3fb532bb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:08.029792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1111/2243] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:07 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:08.357633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1610-9745-475a-8e44-f0f96852518d service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:08.367172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb1610-9745-475a-8e44-f0f96852518d service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:08.371842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3426a7-abb2-47f1-9863-387f24cb5621 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:08.372439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3426a7-abb2-47f1-9863-387f24cb5621 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:08.372714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3426a7-abb2-47f1-9863-387f24cb5621 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:08.372973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3426a7-abb2-47f1-9863-387f24cb5621 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:08.375056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ef3426a7-abb2-47f1-9863-387f24cb5621 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:08.385689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3426a7-abb2-47f1-9863-387f24cb5621 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:08.387266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3426a7-abb2-47f1-9863-387f24cb5621 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:08.396137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1133/2244] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:08.741815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e0fda-a913-478a-923a-4e3fb532bb75 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:08.743745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d97e0fda-a913-478a-923a-4e3fb532bb75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:08.819219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97e0fda-a913-478a-923a-4e3fb532bb75 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:08.824783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b48535-c4bc-49e6-a336-4accc22ef138 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:08.825394 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b48535-c4bc-49e6-a336-4accc22ef138 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:08.825664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b48535-c4bc-49e6-a336-4accc22ef138 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:08.825927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b48535-c4bc-49e6-a336-4accc22ef138 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:08.827864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-72b48535-c4bc-49e6-a336-4accc22ef138 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:08.840120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b48535-c4bc-49e6-a336-4accc22ef138 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:08.841713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b48535-c4bc-49e6-a336-4accc22ef138 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:08.851919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1112/2245] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:11.116674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3426a7-abb2-47f1-9863-387f24cb5621 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:11.125645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3426a7-abb2-47f1-9863-387f24cb5621 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:11.137904 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec2766-d844-4aef-bd9d-f4802121ff85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:11.138569 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec2766-d844-4aef-bd9d-f4802121ff85 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:11.139111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec2766-d844-4aef-bd9d-f4802121ff85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:11.139543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec2766-d844-4aef-bd9d-f4802121ff85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:11.142667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d2ec2766-d844-4aef-bd9d-f4802121ff85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:11.154321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec2766-d844-4aef-bd9d-f4802121ff85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:11.155800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ec2766-d844-4aef-bd9d-f4802121ff85 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:11.164059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1134/2246] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:11 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:11.766616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b48535-c4bc-49e6-a336-4accc22ef138 service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:11.768435 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-72b48535-c4bc-49e6-a336-4accc22ef138 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:11.785660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b48535-c4bc-49e6-a336-4accc22ef138 service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:11.792426 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaa18b-c23e-45cd-ab76-23789f5b63d1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:11.793273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaa18b-c23e-45cd-ab76-23789f5b63d1 service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:11.794243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaa18b-c23e-45cd-ab76-23789f5b63d1 service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:11.794700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7eaa18b-c23e-45cd-ab76-23789f5b63d1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:11.796755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a7eaa18b-c23e-45cd-ab76-23789f5b63d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:11.815347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaa18b-c23e-45cd-ab76-23789f5b63d1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:11.816957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7eaa18b-c23e-45cd-ab76-23789f5b63d1 service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:11.829151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1113/2247] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:21.161018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=12 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:21.466728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec2766-d844-4aef-bd9d-f4802121ff85 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:21.468576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d2ec2766-d844-4aef-bd9d-f4802121ff85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:21.529752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec2766-d844-4aef-bd9d-f4802121ff85 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:21.533466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464044c-513b-458d-a420-742a4ad3bd09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:21.534084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464044c-513b-458d-a420-742a4ad3bd09 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:21.534367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464044c-513b-458d-a420-742a4ad3bd09 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:21.534683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c464044c-513b-458d-a420-742a4ad3bd09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:21.536588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c464044c-513b-458d-a420-742a4ad3bd09 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:21.548017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464044c-513b-458d-a420-742a4ad3bd09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:21.549472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c464044c-513b-458d-a420-742a4ad3bd09 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:21.559406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1135/2248] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:21 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:21.823977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=63 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:24.721890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaa18b-c23e-45cd-ab76-23789f5b63d1 service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:24.723577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a7eaa18b-c23e-45cd-ab76-23789f5b63d1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:24.736538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7eaa18b-c23e-45cd-ab76-23789f5b63d1 service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:24.741105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a18b5d-95e5-4947-99d5-fcbfa562f8d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:24.741702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a18b5d-95e5-4947-99d5-fcbfa562f8d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:24.741979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a18b5d-95e5-4947-99d5-fcbfa562f8d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:24.742234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a18b5d-95e5-4947-99d5-fcbfa562f8d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:24.744283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e4a18b5d-95e5-4947-99d5-fcbfa562f8d9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:24.807366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a18b5d-95e5-4947-99d5-fcbfa562f8d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:24.808811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a18b5d-95e5-4947-99d5-fcbfa562f8d9 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:24.818218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1114/2249] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:31.554563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=26 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:31.893972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464044c-513b-458d-a420-742a4ad3bd09 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:31.908214 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c464044c-513b-458d-a420-742a4ad3bd09 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:31.931224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d45b1-3a40-4ace-97cc-15d2ee04f5ea service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:31.931851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d45b1-3a40-4ace-97cc-15d2ee04f5ea service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:31.932257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d45b1-3a40-4ace-97cc-15d2ee04f5ea service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:31.932390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285d45b1-3a40-4ace-97cc-15d2ee04f5ea service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:31.934727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-285d45b1-3a40-4ace-97cc-15d2ee04f5ea service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:31.948004 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d45b1-3a40-4ace-97cc-15d2ee04f5ea service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:31.949733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285d45b1-3a40-4ace-97cc-15d2ee04f5ea service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:31.959524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1136/2250] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:31 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:33.330901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2835ff-df64-4737-b410-0498803f4e11 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:33.331448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2835ff-df64-4737-b410-0498803f4e11 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:33.331448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2835ff-df64-4737-b410-0498803f4e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:33.352003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3a2835ff-df64-4737-b410-0498803f4e11 None None] MFA Rules not processed for user `b44b18da73814fe78173631173a245c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:33.353239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3a2835ff-df64-4737-b410-0498803f4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:33.360613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1115/2251] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:33.691790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d45b1-3a40-4ace-97cc-15d2ee04f5ea service nova] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:33.702677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285d45b1-3a40-4ace-97cc-15d2ee04f5ea service nova] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:33.707179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9efda-5414-402a-9c66-555ece4fd130 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:33.707879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9efda-5414-402a-9c66-555ece4fd130 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:33.708421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9efda-5414-402a-9c66-555ece4fd130 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:33.708754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9efda-5414-402a-9c66-555ece4fd130 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:33.711072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6ba9efda-5414-402a-9c66-555ece4fd130 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:33.726223 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9efda-5414-402a-9c66-555ece4fd130 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:33.727790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9efda-5414-402a-9c66-555ece4fd130 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:33.737715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1137/2252] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:37.317952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2835ff-df64-4737-b410-0498803f4e11 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:37.341813 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2835ff-df64-4737-b410-0498803f4e11 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:37.355852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed554773-ade9-4a4c-93e6-dda452a31e0c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:37.358357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed554773-ade9-4a4c-93e6-dda452a31e0c service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:37.358740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed554773-ade9-4a4c-93e6-dda452a31e0c service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:37.359255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed554773-ade9-4a4c-93e6-dda452a31e0c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:37.364634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ed554773-ade9-4a4c-93e6-dda452a31e0c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:37.380487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed554773-ade9-4a4c-93e6-dda452a31e0c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:37.382581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed554773-ade9-4a4c-93e6-dda452a31e0c service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:37.399957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1116/2253] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:43.733232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=12 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:45.185862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9efda-5414-402a-9c66-555ece4fd130 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:45.194669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9efda-5414-402a-9c66-555ece4fd130 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:45.198411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463d83b-d876-4408-a2c6-76558dc21d3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:45.199052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d83b-d876-4408-a2c6-76558dc21d3b service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:45.199330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d83b-d876-4408-a2c6-76558dc21d3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:45.199608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0463d83b-d876-4408-a2c6-76558dc21d3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:45.201293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0463d83b-d876-4408-a2c6-76558dc21d3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:45.267858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463d83b-d876-4408-a2c6-76558dc21d3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:45.269307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0463d83b-d876-4408-a2c6-76558dc21d3b service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:45.280475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1138/2254] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:47.391137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=37 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:47.855442 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed554773-ade9-4a4c-93e6-dda452a31e0c service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:47.872308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed554773-ade9-4a4c-93e6-dda452a31e0c service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:47.878987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6520088-a3ed-42b4-8ad3-25ad5d67a05e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:47.880019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6520088-a3ed-42b4-8ad3-25ad5d67a05e service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:47.880451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6520088-a3ed-42b4-8ad3-25ad5d67a05e service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:47.880923 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6520088-a3ed-42b4-8ad3-25ad5d67a05e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:47.882915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b6520088-a3ed-42b4-8ad3-25ad5d67a05e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:47.906824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6520088-a3ed-42b4-8ad3-25ad5d67a05e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:47.908429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6520088-a3ed-42b4-8ad3-25ad5d67a05e service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:47.921051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1117/2255] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:49.248221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463d83b-d876-4408-a2c6-76558dc21d3b service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:49.269227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0463d83b-d876-4408-a2c6-76558dc21d3b service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:49.276865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be84f0-e5c3-42a7-bb68-d3c1dc29238f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:49.277499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be84f0-e5c3-42a7-bb68-d3c1dc29238f service placement] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:49.277919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be84f0-e5c3-42a7-bb68-d3c1dc29238f service placement] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:49.278212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5be84f0-e5c3-42a7-bb68-d3c1dc29238f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:49.280421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a5be84f0-e5c3-42a7-bb68-d3c1dc29238f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:49.295747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be84f0-e5c3-42a7-bb68-d3c1dc29238f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:49.297382 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5be84f0-e5c3-42a7-bb68-d3c1dc29238f service placement] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:49.308819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1139/2256] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:49.333849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6520088-a3ed-42b4-8ad3-25ad5d67a05e service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:49.339755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b6520088-a3ed-42b4-8ad3-25ad5d67a05e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:49.353486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6520088-a3ed-42b4-8ad3-25ad5d67a05e service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:49.359649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:49.360315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:49.360604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:49.361063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] PATH_INFO: `/v3/users/b9277840830b454c9097109a45d48927` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:49.362322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9277840830b454c9097109a45d48927)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:49.365015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:49.425005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9277840830b454c9097109a45d48927'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:49.425608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9277840830b454c9097109a45d48927'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:49.426747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9277840830b454c9097109a45d48927'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:49.445111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9277840830b454c9097109a45d48927'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:49.453567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-442e17d6-be72-4e08-966c-76ea9df67c7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9277840830b454c9097109a45d48927'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:49.467946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1118/2257] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:11:49 2022] DELETE /identity/v3/users/b9277840830b454c9097109a45d48927 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:11:49.689643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be84f0-e5c3-42a7-bb68-d3c1dc29238f service placement] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:49.708738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5be84f0-e5c3-42a7-bb68-d3c1dc29238f service placement] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:49.783651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:49.784646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:49.784921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:49.785224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] PATH_INFO: `/v3/projects/09d40643694645c19149559a3e33af0c` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:49.787066 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=09d40643694645c19149559a3e33af0c)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:49.789042 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:49.841731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09d40643694645c19149559a3e33af0c', 'request_id': 'req-7beaa7a1-5ef1-412e-8463-20ccef0585ff'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:49.847181 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09d40643694645c19149559a3e33af0c', 'request_id': 'req-7beaa7a1-5ef1-412e-8463-20ccef0585ff'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:49.856011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09d40643694645c19149559a3e33af0c', 'request_id': 'req-7beaa7a1-5ef1-412e-8463-20ccef0585ff'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:49.868159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] The token cache is being invalidate because project 09d40643694645c19149559a3e33af0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:11:49.868452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:49.869197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7beaa7a1-5ef1-412e-8463-20ccef0585ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:49.870886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1140/2258] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:11:49 2022] DELETE /identity/v3/projects/09d40643694645c19149559a3e33af0c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:11:49.876054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a179c9-3f48-4cac-8a1d-c0bb7bf4a775 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:49.876358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a179c9-3f48-4cac-8a1d-c0bb7bf4a775 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:49.876652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a179c9-3f48-4cac-8a1d-c0bb7bf4a775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:49.898295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-17a179c9-3f48-4cac-8a1d-c0bb7bf4a775 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:49.899664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-17a179c9-3f48-4cac-8a1d-c0bb7bf4a775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:50.033383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1119/2259] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:50.041246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62851f-c47e-4179-9a78-ad0ccb4a8fc9 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:50.041540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62851f-c47e-4179-9a78-ad0ccb4a8fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:50.041815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd62851f-c47e-4179-9a78-ad0ccb4a8fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:50.064100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-fd62851f-c47e-4179-9a78-ad0ccb4a8fc9 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:50.065343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-fd62851f-c47e-4179-9a78-ad0ccb4a8fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:50.076332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1141/2260] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:50.080769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a179c9-3f48-4cac-8a1d-c0bb7bf4a775 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:50.095191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a179c9-3f48-4cac-8a1d-c0bb7bf4a775 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:50.101326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab89ec-c005-4174-8952-5fed2bbcd643 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:50.102020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab89ec-c005-4174-8952-5fed2bbcd643 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:50.102356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab89ec-c005-4174-8952-5fed2bbcd643 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:50.102702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ab89ec-c005-4174-8952-5fed2bbcd643 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:50.103544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab89ec-c005-4174-8952-5fed2bbcd643 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:11:50.103892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab89ec-c005-4174-8952-5fed2bbcd643 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:50.105919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ab89ec-c005-4174-8952-5fed2bbcd643 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:50.122072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1120/2261] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:11:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:11:50.127048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62851f-c47e-4179-9a78-ad0ccb4a8fc9 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:50.135063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:50.138622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd62851f-c47e-4179-9a78-ad0ccb4a8fc9 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:50.145903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f88119-9015-493b-8b29-8cf24f0961e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:50.146730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f88119-9015-493b-8b29-8cf24f0961e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:50.147143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f88119-9015-493b-8b29-8cf24f0961e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:50.147529 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f88119-9015-493b-8b29-8cf24f0961e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:50.148412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f88119-9015-493b-8b29-8cf24f0961e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:50.150818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f88119-9015-493b-8b29-8cf24f0961e0 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:50.194169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1142/2262] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:11:50 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:11:50.198519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab89ec-c005-4174-8952-5fed2bbcd643 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:50.209397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ab89ec-c005-4174-8952-5fed2bbcd643 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:50.280254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:50.308287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25c12d-0565-42ff-9257-ad35ff88f839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:50.313445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25c12d-0565-42ff-9257-ad35ff88f839 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:50.313936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25c12d-0565-42ff-9257-ad35ff88f839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:50.315261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25c12d-0565-42ff-9257-ad35ff88f839 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:50.316209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25c12d-0565-42ff-9257-ad35ff88f839 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:50.319853 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25c12d-0565-42ff-9257-ad35ff88f839 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:50.355238 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f88119-9015-493b-8b29-8cf24f0961e0 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:50.362817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1121/2263] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:11:50 2022] POST /identity/v3/users => generated 287 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:11:50.367701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f88119-9015-493b-8b29-8cf24f0961e0 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:50.373885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437bb22-8d17-4192-9923-53e2d907429d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:50.375010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437bb22-8d17-4192-9923-53e2d907429d admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:50.375433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437bb22-8d17-4192-9923-53e2d907429d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:50.375851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f437bb22-8d17-4192-9923-53e2d907429d admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:50.377683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437bb22-8d17-4192-9923-53e2d907429d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:50.380409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f437bb22-8d17-4192-9923-53e2d907429d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:50.395555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1143/2264] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:11:50.399918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25c12d-0565-42ff-9257-ad35ff88f839 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:50.411201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25c12d-0565-42ff-9257-ad35ff88f839 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:50.417764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e994dcc1-ed2c-4956-969d-bb1c5b15f705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:50.418623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994dcc1-ed2c-4956-969d-bb1c5b15f705 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:50.418943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994dcc1-ed2c-4956-969d-bb1c5b15f705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:50.419220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e994dcc1-ed2c-4956-969d-bb1c5b15f705 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:50.419892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994dcc1-ed2c-4956-969d-bb1c5b15f705 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:50.421612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e994dcc1-ed2c-4956-969d-bb1c5b15f705 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:50.435941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1122/2265] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:11:50 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:11:50.440411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437bb22-8d17-4192-9923-53e2d907429d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:50.452056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f437bb22-8d17-4192-9923-53e2d907429d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:50.458826 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9794f-68d3-4c76-afd4-deb5422f2b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:50.459587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9794f-68d3-4c76-afd4-deb5422f2b2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:50.459939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9794f-68d3-4c76-afd4-deb5422f2b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:50.460284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd9794f-68d3-4c76-afd4-deb5422f2b2d admin admin] PATH_INFO: `/v3/projects/a21f560670fe4d138f1177d439a425b9/users/561c3deaa00246bf8a6a04e0b8693d41/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:50.481490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9794f-68d3-4c76-afd4-deb5422f2b2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21f560670fe4d138f1177d439a425b9, user_id=561c3deaa00246bf8a6a04e0b8693d41, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:50.484611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd9794f-68d3-4c76-afd4-deb5422f2b2d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:50.503968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1144/2266] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:11:50 2022] PUT /identity/v3/projects/a21f560670fe4d138f1177d439a425b9/users/561c3deaa00246bf8a6a04e0b8693d41/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:11:50.515714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2a41-f065-4f3c-bbbf-c794a83de455 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:50.516112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2a41-f065-4f3c-bbbf-c794a83de455 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:50.516577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eba2a41-f065-4f3c-bbbf-c794a83de455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:50.552061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1eba2a41-f065-4f3c-bbbf-c794a83de455 None None] MFA Rules not processed for user `561c3deaa00246bf8a6a04e0b8693d41`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:50.552980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1eba2a41-f065-4f3c-bbbf-c794a83de455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:50.661664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1123/2267] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:50 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:50.672503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9794f-68d3-4c76-afd4-deb5422f2b2d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:50.674747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7cd9794f-68d3-4c76-afd4-deb5422f2b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:50.792180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd9794f-68d3-4c76-afd4-deb5422f2b2d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:50.798541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7002c96-c06b-4793-ad84-9d2b439577e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:50.799283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002c96-c06b-4793-ad84-9d2b439577e5 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:50.799622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002c96-c06b-4793-ad84-9d2b439577e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:50.799963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7002c96-c06b-4793-ad84-9d2b439577e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:50.808978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7002c96-c06b-4793-ad84-9d2b439577e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:50.810939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7002c96-c06b-4793-ad84-9d2b439577e5 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:50.821786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1145/2268] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:50 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:51.086230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba2a41-f065-4f3c-bbbf-c794a83de455 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:51.189514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eba2a41-f065-4f3c-bbbf-c794a83de455 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:51.202019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:51.203783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:51.204411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:51.204597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] PATH_INFO: `/v3/users/561c3deaa00246bf8a6a04e0b8693d41` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:51.205782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] RBAC: Authorizing `identity:delete_user(user_id=561c3deaa00246bf8a6a04e0b8693d41)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:51.208314 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:51.285073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '561c3deaa00246bf8a6a04e0b8693d41'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:51.286140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '561c3deaa00246bf8a6a04e0b8693d41'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:51.287087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '561c3deaa00246bf8a6a04e0b8693d41'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:51.297211 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:INSERT=3,keystone:DELETE=8 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:51.315719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '561c3deaa00246bf8a6a04e0b8693d41'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:51.326263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '561c3deaa00246bf8a6a04e0b8693d41'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:51.344362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1124/2269] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:11:51 2022] DELETE /identity/v3/users/561c3deaa00246bf8a6a04e0b8693d41 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:11:51.349356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6c2af-d83e-471e-adbc-645286dfa8e1 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:51.349828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6c2af-d83e-471e-adbc-645286dfa8e1 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:51.350222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af6c2af-d83e-471e-adbc-645286dfa8e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:51.393756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-2af6c2af-d83e-471e-adbc-645286dfa8e1 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:51.395298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2af6c2af-d83e-471e-adbc-645286dfa8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:51.499900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1146/2270] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:51.520815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:51.522482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:51.614806 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638aff73-6cf8-4475-bad0-dc2132d5335b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:51.622972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58d09aa-afa7-41d6-8ab5-e89bd1aaa412 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:51.625187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d09aa-afa7-41d6-8ab5-e89bd1aaa412 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:51.625475 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d09aa-afa7-41d6-8ab5-e89bd1aaa412 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:51.625824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58d09aa-afa7-41d6-8ab5-e89bd1aaa412 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:51.644101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d09aa-afa7-41d6-8ab5-e89bd1aaa412 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:51.646298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58d09aa-afa7-41d6-8ab5-e89bd1aaa412 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:51.671328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1125/2271] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:52.296222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6c2af-d83e-471e-adbc-645286dfa8e1 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:52.297947 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2af6c2af-d83e-471e-adbc-645286dfa8e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:52.323098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af6c2af-d83e-471e-adbc-645286dfa8e1 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:52.328897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:52.329901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:52.330616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:52.331183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] PATH_INFO: `/v3/projects/a21f560670fe4d138f1177d439a425b9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:52.332763 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21f560670fe4d138f1177d439a425b9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:52.335185 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:52.382872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:52.419689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21f560670fe4d138f1177d439a425b9', 'request_id': 'req-2e120aed-6eea-4d15-af32-490271d15700'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:52.431271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21f560670fe4d138f1177d439a425b9', 'request_id': 'req-2e120aed-6eea-4d15-af32-490271d15700'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:52.445156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21f560670fe4d138f1177d439a425b9', 'request_id': 'req-2e120aed-6eea-4d15-af32-490271d15700'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:52.461461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] The token cache is being invalidate because project a21f560670fe4d138f1177d439a425b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:11:52.461906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:52.462996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-2e120aed-6eea-4d15-af32-490271d15700 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:52.469338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1147/2272] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:11:52 2022] DELETE /identity/v3/projects/a21f560670fe4d138f1177d439a425b9 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:11:52.470859 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40ab3-8447-43e9-8a02-1a7ccc1dd6cc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:52.471346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40ab3-8447-43e9-8a02-1a7ccc1dd6cc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:52.471781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40ab3-8447-43e9-8a02-1a7ccc1dd6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:52.494591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8ef40ab3-8447-43e9-8a02-1a7ccc1dd6cc None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:52.497082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8ef40ab3-8447-43e9-8a02-1a7ccc1dd6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:52.606484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1126/2273] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:11:52.609473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935713c-c052-45b1-8957-a8c5d376acd3 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:52.609832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935713c-c052-45b1-8957-a8c5d376acd3 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:52.610232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935713c-c052-45b1-8957-a8c5d376acd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:52.644003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-5935713c-c052-45b1-8957-a8c5d376acd3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:52.645634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5935713c-c052-45b1-8957-a8c5d376acd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:52.658876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1148/2274] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:52.660888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef40ab3-8447-43e9-8a02-1a7ccc1dd6cc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:52.689154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef40ab3-8447-43e9-8a02-1a7ccc1dd6cc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:52.710877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed69a2-2970-4763-b0f6-4b005a4496f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:52.711577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed69a2-2970-4763-b0f6-4b005a4496f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:52.713778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed69a2-2970-4763-b0f6-4b005a4496f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:52.714168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfed69a2-2970-4763-b0f6-4b005a4496f9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:52.714983 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed69a2-2970-4763-b0f6-4b005a4496f9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:11:52.715522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed69a2-2970-4763-b0f6-4b005a4496f9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:52.723915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfed69a2-2970-4763-b0f6-4b005a4496f9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:52.752730 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1127/2275] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:11:52.758845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935713c-c052-45b1-8957-a8c5d376acd3 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:52.772431 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935713c-c052-45b1-8957-a8c5d376acd3 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:52.778185 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74605009-8c38-4b19-8adb-872502126b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:52.778925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74605009-8c38-4b19-8adb-872502126b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:52.779381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74605009-8c38-4b19-8adb-872502126b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:52.779678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74605009-8c38-4b19-8adb-872502126b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:52.780866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74605009-8c38-4b19-8adb-872502126b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:52.782888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74605009-8c38-4b19-8adb-872502126b88 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:52.857597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1149/2276] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:11:52 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:11:52.859083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed69a2-2970-4763-b0f6-4b005a4496f9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:52.876144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfed69a2-2970-4763-b0f6-4b005a4496f9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:52.980516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8a49-5af2-4e9d-bb03-aaa4e01c3fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:52.981293 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8a49-5af2-4e9d-bb03-aaa4e01c3fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:52.981607 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8a49-5af2-4e9d-bb03-aaa4e01c3fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:52.981876 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f8a49-5af2-4e9d-bb03-aaa4e01c3fd2 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:52.982518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f8a49-5af2-4e9d-bb03-aaa4e01c3fd2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:52.984519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974f8a49-5af2-4e9d-bb03-aaa4e01c3fd2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.000407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:53.022838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74605009-8c38-4b19-8adb-872502126b88 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.023401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1128/2277] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:11:52 2022] POST /identity/v3/users => generated 283 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:11:53.035284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74605009-8c38-4b19-8adb-872502126b88 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:53.040976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77678d2d-e155-414f-a4a6-09a08109b7c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:53.041706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77678d2d-e155-414f-a4a6-09a08109b7c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.041988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77678d2d-e155-414f-a4a6-09a08109b7c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.042262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77678d2d-e155-414f-a4a6-09a08109b7c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.043100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77678d2d-e155-414f-a4a6-09a08109b7c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:53.044842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77678d2d-e155-414f-a4a6-09a08109b7c6 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.062554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8a49-5af2-4e9d-bb03-aaa4e01c3fd2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.071168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1150/2278] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:11:53.075694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f8a49-5af2-4e9d-bb03-aaa4e01c3fd2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:53.087047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254cac6a-1f35-46aa-a641-f1c9bf3894f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:53.087729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cac6a-1f35-46aa-a641-f1c9bf3894f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.088155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cac6a-1f35-46aa-a641-f1c9bf3894f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.088433 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254cac6a-1f35-46aa-a641-f1c9bf3894f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.089153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cac6a-1f35-46aa-a641-f1c9bf3894f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:53.091018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254cac6a-1f35-46aa-a641-f1c9bf3894f7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.107171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1129/2279] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:11:53.109459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77678d2d-e155-414f-a4a6-09a08109b7c6 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.121671 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77678d2d-e155-414f-a4a6-09a08109b7c6 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:53.128222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeb3f2-d360-4ec4-a9a5-3c624ea9f05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:53.129112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeb3f2-d360-4ec4-a9a5-3c624ea9f05d admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.129402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeb3f2-d360-4ec4-a9a5-3c624ea9f05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.129778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efeb3f2-d360-4ec4-a9a5-3c624ea9f05d admin admin] PATH_INFO: `/v3/projects/09deae1917c9476d9ec4eaa92a26b521/users/a6804b8222b74c84bab14cefa46d9cb0/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.148536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efeb3f2-d360-4ec4-a9a5-3c624ea9f05d admin admin] RBAC: Authorizing `identity:create_grant(project_id=09deae1917c9476d9ec4eaa92a26b521, user_id=a6804b8222b74c84bab14cefa46d9cb0, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:53.151484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efeb3f2-d360-4ec4-a9a5-3c624ea9f05d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.170884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1151/2280] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:11:53 2022] PUT /identity/v3/projects/09deae1917c9476d9ec4eaa92a26b521/users/a6804b8222b74c84bab14cefa46d9cb0/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:11:53.182102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab132c-24e7-4098-9930-09e38e2cc32b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.182483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab132c-24e7-4098-9930-09e38e2cc32b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.182672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bab132c-24e7-4098-9930-09e38e2cc32b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.213969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5bab132c-24e7-4098-9930-09e38e2cc32b None None] MFA Rules not processed for user `a6804b8222b74c84bab14cefa46d9cb0`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:53.215467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5bab132c-24e7-4098-9930-09e38e2cc32b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:53.307361 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1130/2281] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:53.312630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeb3f2-d360-4ec4-a9a5-3c624ea9f05d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.424869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efeb3f2-d360-4ec4-a9a5-3c624ea9f05d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:53.433420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46593bed-0086-42ba-b083-8bbc9f044a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:53.434267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46593bed-0086-42ba-b083-8bbc9f044a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.434915 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46593bed-0086-42ba-b083-8bbc9f044a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.435238 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46593bed-0086-42ba-b083-8bbc9f044a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.435872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46593bed-0086-42ba-b083-8bbc9f044a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:53.438472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46593bed-0086-42ba-b083-8bbc9f044a6f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.467627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2340f3-13f5-4a6a-ac9f-78c56d974d42 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.468127 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2340f3-13f5-4a6a-ac9f-78c56d974d42 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.468574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2340f3-13f5-4a6a-ac9f-78c56d974d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.486076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1152/2282] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:11:53 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:11:53.490708 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46593bed-0086-42ba-b083-8bbc9f044a6f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.492960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1a2340f3-13f5-4a6a-ac9f-78c56d974d42 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:53.494296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1a2340f3-13f5-4a6a-ac9f-78c56d974d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:53.546243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:53.568157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1131/2283] 10.222.0.59 () {58 vars in 967 bytes} [Thu Aug 18 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:11:53.571646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46593bed-0086-42ba-b083-8bbc9f044a6f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:53.577648 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ccb11-59f5-470e-9109-3245a9a4937d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:53.578263 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ccb11-59f5-470e-9109-3245a9a4937d admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.578540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ccb11-59f5-470e-9109-3245a9a4937d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.578839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426ccb11-59f5-470e-9109-3245a9a4937d admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.579487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ccb11-59f5-470e-9109-3245a9a4937d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:53.581766 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426ccb11-59f5-470e-9109-3245a9a4937d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.608803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1153/2284] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:11:53 2022] POST /identity/v3/users => generated 291 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:11:53.613832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2340f3-13f5-4a6a-ac9f-78c56d974d42 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.627844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2340f3-13f5-4a6a-ac9f-78c56d974d42 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:53.630941 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ccb11-59f5-470e-9109-3245a9a4937d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.633258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-426ccb11-59f5-470e-9109-3245a9a4937d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:53.636517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7148a0-3ead-4452-a652-ec158bc79361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:53.637139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7148a0-3ead-4452-a652-ec158bc79361 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.637530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7148a0-3ead-4452-a652-ec158bc79361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.637702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7148a0-3ead-4452-a652-ec158bc79361 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.638394 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7148a0-3ead-4452-a652-ec158bc79361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:53.640141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7148a0-3ead-4452-a652-ec158bc79361 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.653196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1132/2285] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:11:53.657621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7148a0-3ead-4452-a652-ec158bc79361 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.669024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7148a0-3ead-4452-a652-ec158bc79361 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:53.674909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4cfd8-f2d3-46d7-81db-ca4cc0e4ae68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:53.675690 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4cfd8-f2d3-46d7-81db-ca4cc0e4ae68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.676007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4cfd8-f2d3-46d7-81db-ca4cc0e4ae68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.677152 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c4cfd8-f2d3-46d7-81db-ca4cc0e4ae68 admin admin] PATH_INFO: `/v3/projects/705c2963dcde4e6f8ff928a45456bf5c/users/3f343472c6724d80b8a619ef4b6099af/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.694793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4cfd8-f2d3-46d7-81db-ca4cc0e4ae68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=705c2963dcde4e6f8ff928a45456bf5c, user_id=3f343472c6724d80b8a619ef4b6099af, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:53.698059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c4cfd8-f2d3-46d7-81db-ca4cc0e4ae68 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.715679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1133/2286] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:11:53 2022] PUT /identity/v3/projects/705c2963dcde4e6f8ff928a45456bf5c/users/3f343472c6724d80b8a619ef4b6099af/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:11:53.718744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426ccb11-59f5-470e-9109-3245a9a4937d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:53.719658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4cfd8-f2d3-46d7-81db-ca4cc0e4ae68 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.776085 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:53.795825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c4cfd8-f2d3-46d7-81db-ca4cc0e4ae68 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:53.800486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b1e2a-8f6a-4e12-8e06-0e53530befad service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:53.800626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8bcb1-cc24-4ed1-bbd6-1678ceacaa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:53.801160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b1e2a-8f6a-4e12-8e06-0e53530befad service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.801275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8bcb1-cc24-4ed1-bbd6-1678ceacaa80 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.801617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b1e2a-8f6a-4e12-8e06-0e53530befad service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.801617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938b1e2a-8f6a-4e12-8e06-0e53530befad service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.802218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8bcb1-cc24-4ed1-bbd6-1678ceacaa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.802218 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c8bcb1-cc24-4ed1-bbd6-1678ceacaa80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.802801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8bcb1-cc24-4ed1-bbd6-1678ceacaa80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:53.804520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c8bcb1-cc24-4ed1-bbd6-1678ceacaa80 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.815536 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1134/2287] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:11:53 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:11:53.822071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8bcb1-cc24-4ed1-bbd6-1678ceacaa80 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.832101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c8bcb1-cc24-4ed1-bbd6-1678ceacaa80 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:53.837281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf08784-0acb-4d11-9605-ff31e9eae5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:53.837934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf08784-0acb-4d11-9605-ff31e9eae5cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.838213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf08784-0acb-4d11-9605-ff31e9eae5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.838547 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf08784-0acb-4d11-9605-ff31e9eae5cd admin admin] PATH_INFO: `/v3/projects/705c2963dcde4e6f8ff928a45456bf5c/users/3f343472c6724d80b8a619ef4b6099af/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.840778 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf08784-0acb-4d11-9605-ff31e9eae5cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=705c2963dcde4e6f8ff928a45456bf5c, user_id=3f343472c6724d80b8a619ef4b6099af, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:53.843756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf08784-0acb-4d11-9605-ff31e9eae5cd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.855066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1135/2288] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:11:53 2022] PUT /identity/v3/projects/705c2963dcde4e6f8ff928a45456bf5c/users/3f343472c6724d80b8a619ef4b6099af/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:11:53.857652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b1e2a-8f6a-4e12-8e06-0e53530befad service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:53.859294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938b1e2a-8f6a-4e12-8e06-0e53530befad service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:53.867631 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1154/2289] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:11:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:11:53.867905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defa80a-8ef5-4387-8843-f5c204c395d5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:53.868170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defa80a-8ef5-4387-8843-f5c204c395d5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:53.868443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7defa80a-8ef5-4387-8843-f5c204c395d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:53.899912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7defa80a-8ef5-4387-8843-f5c204c395d5 None None] MFA Rules not processed for user `3f343472c6724d80b8a619ef4b6099af`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:53.901134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7defa80a-8ef5-4387-8843-f5c204c395d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:53.984911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1136/2290] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:53 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:11:53.997315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b1e2a-8f6a-4e12-8e06-0e53530befad service swift] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:53.998640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-938b1e2a-8f6a-4e12-8e06-0e53530befad service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:54.022186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:54.091101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938b1e2a-8f6a-4e12-8e06-0e53530befad service swift] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:54.176525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ad450-dbc1-4281-aeb6-af28b1e41984 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:54.177184 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad450-dbc1-4281-aeb6-af28b1e41984 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:54.177541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad450-dbc1-4281-aeb6-af28b1e41984 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:54.177819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181ad450-dbc1-4281-aeb6-af28b1e41984 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:54.198690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ad450-dbc1-4281-aeb6-af28b1e41984 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:54.200302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181ad450-dbc1-4281-aeb6-af28b1e41984 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:54.202313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac98c-1367-4172-9f88-4de883408ff0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:54.202546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac98c-1367-4172-9f88-4de883408ff0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:54.202867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024ac98c-1367-4172-9f88-4de883408ff0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:54.213824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1155/2291] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:53 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:54.225912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-024ac98c-1367-4172-9f88-4de883408ff0 None None] MFA Rules not processed for user `bfe3817d4e7241e689e6ecc095e938ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:54.227290 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-024ac98c-1367-4172-9f88-4de883408ff0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:54.342810 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1137/2292] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:11:55.971513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ad450-dbc1-4281-aeb6-af28b1e41984 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:56.053756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181ad450-dbc1-4281-aeb6-af28b1e41984 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:56.060817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:56.062713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:56.063119 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:56.063493 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] PATH_INFO: `/v3/users/a6804b8222b74c84bab14cefa46d9cb0` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:56.065292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6804b8222b74c84bab14cefa46d9cb0)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:56.068652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:56.137003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6804b8222b74c84bab14cefa46d9cb0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:56.160011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6804b8222b74c84bab14cefa46d9cb0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:56.174082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6804b8222b74c84bab14cefa46d9cb0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:56.176555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:56.190619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6804b8222b74c84bab14cefa46d9cb0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:56.192517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6804b8222b74c84bab14cefa46d9cb0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:56.204353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1156/2293] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:11:55 2022] DELETE /identity/v3/users/a6804b8222b74c84bab14cefa46d9cb0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:11:56.210134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c1dc1-a0ba-4a29-b62e-4c68263fc97a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:56.211004 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c1dc1-a0ba-4a29-b62e-4c68263fc97a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:56.211287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92c1dc1-a0ba-4a29-b62e-4c68263fc97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:56.239285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d92c1dc1-a0ba-4a29-b62e-4c68263fc97a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:56.241101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d92c1dc1-a0ba-4a29-b62e-4c68263fc97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:56.318269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:56.338030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1138/2294] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:56.353868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:56.356518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:56.458755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aa889b-7828-42bd-8b9d-652967d131fe admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:56.463876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd65f0-bb32-465a-8ab2-a7dbce53b922 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:56.464610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd65f0-bb32-465a-8ab2-a7dbce53b922 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:56.464951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd65f0-bb32-465a-8ab2-a7dbce53b922 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:56.465355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd65f0-bb32-465a-8ab2-a7dbce53b922 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:56.482386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd65f0-bb32-465a-8ab2-a7dbce53b922 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:56.485480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd65f0-bb32-465a-8ab2-a7dbce53b922 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:56.501261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1157/2295] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:11:57.076867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad12599-089c-4667-812d-4946f46a9cd1 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:57.077752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad12599-089c-4667-812d-4946f46a9cd1 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:57.078031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad12599-089c-4667-812d-4946f46a9cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:57.108183 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fad12599-089c-4667-812d-4946f46a9cd1 None None] MFA Rules not processed for user `dda19c20bfec49b8b9e1d589f7e3e188`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:57.110205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fad12599-089c-4667-812d-4946f46a9cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:57.194645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd65f0-bb32-465a-8ab2-a7dbce53b922 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:57.197293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c2fd65f0-bb32-465a-8ab2-a7dbce53b922 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:57.225268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd65f0-bb32-465a-8ab2-a7dbce53b922 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:57.241997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:57.244015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:57.245559 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:57.246161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] PATH_INFO: `/v3/projects/09deae1917c9476d9ec4eaa92a26b521` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:57.250258 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] RBAC: Authorizing `identity:delete_project(project_id=09deae1917c9476d9ec4eaa92a26b521)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:57.254490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:57.257462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1139/2296] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:57.370900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '09deae1917c9476d9ec4eaa92a26b521', 'request_id': 'req-c86243bf-118e-4da0-9443-5c378856c681'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:57.395282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '09deae1917c9476d9ec4eaa92a26b521', 'request_id': 'req-c86243bf-118e-4da0-9443-5c378856c681'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:57.416644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '09deae1917c9476d9ec4eaa92a26b521', 'request_id': 'req-c86243bf-118e-4da0-9443-5c378856c681'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:57.435982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] The token cache is being invalidate because project 09deae1917c9476d9ec4eaa92a26b521 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:11:57.438411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:57.440159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:57.446530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1158/2297] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:11:57 2022] DELETE /identity/v3/projects/09deae1917c9476d9ec4eaa92a26b521 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:11:57.449019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad12599-089c-4667-812d-4946f46a9cd1 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:57.466604 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad12599-089c-4667-812d-4946f46a9cd1 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:57.575500 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:57.577345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:57.577852 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:57.580805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] PATH_INFO: `/v3/users/3f343472c6724d80b8a619ef4b6099af` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:57.581920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f343472c6724d80b8a619ef4b6099af)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:57.584829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:57.654288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f343472c6724d80b8a619ef4b6099af'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:57.656789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f343472c6724d80b8a619ef4b6099af'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:57.657696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f343472c6724d80b8a619ef4b6099af'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:57.672997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f343472c6724d80b8a619ef4b6099af'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:57.689098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-7fcce496-c2ef-4cbc-86db-a891271c279f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f343472c6724d80b8a619ef4b6099af'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:57.709745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1140/2298] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:11:57 2022] DELETE /identity/v3/users/3f343472c6724d80b8a619ef4b6099af => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:11:58.319037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:58.323325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:58.359771 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86243bf-118e-4da0-9443-5c378856c681 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:58.469226 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:58.477497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:58.478642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:58.479103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] PATH_INFO: `/v3/projects/705c2963dcde4e6f8ff928a45456bf5c` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:58.481980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] RBAC: Authorizing `identity:delete_project(project_id=705c2963dcde4e6f8ff928a45456bf5c)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:58.484939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:58.514686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:58.581508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '705c2963dcde4e6f8ff928a45456bf5c', 'request_id': 'req-0025a32f-080c-4cd0-a20b-bf1a2a82987a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:58.592347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '705c2963dcde4e6f8ff928a45456bf5c', 'request_id': 'req-0025a32f-080c-4cd0-a20b-bf1a2a82987a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:58.621728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '705c2963dcde4e6f8ff928a45456bf5c', 'request_id': 'req-0025a32f-080c-4cd0-a20b-bf1a2a82987a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:58.642451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] The token cache is being invalidate because project 705c2963dcde4e6f8ff928a45456bf5c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:11:58.642810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:58.645626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0025a32f-080c-4cd0-a20b-bf1a2a82987a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:11:58.647553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1159/2299] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:11:58 2022] DELETE /identity/v3/projects/705c2963dcde4e6f8ff928a45456bf5c => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:11:58.653411 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d89544-d3ba-4723-9fec-ce4d0b2beac6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:58.653899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d89544-d3ba-4723-9fec-ce4d0b2beac6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:58.654010 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d89544-d3ba-4723-9fec-ce4d0b2beac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:58.716414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b8d89544-d3ba-4723-9fec-ce4d0b2beac6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:58.717684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b8d89544-d3ba-4723-9fec-ce4d0b2beac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:58.734618 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:11:58.833407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1141/2300] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:11:58.841892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadba85f-1e2d-4906-893c-6ec3ad1a37f3 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:58.842279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadba85f-1e2d-4906-893c-6ec3ad1a37f3 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:58.842688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadba85f-1e2d-4906-893c-6ec3ad1a37f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:58.887862 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-eadba85f-1e2d-4906-893c-6ec3ad1a37f3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:58.892465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-eadba85f-1e2d-4906-893c-6ec3ad1a37f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:58.912516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1160/2301] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:58.916672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d89544-d3ba-4723-9fec-ce4d0b2beac6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:58.929911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d89544-d3ba-4723-9fec-ce4d0b2beac6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:58.940854 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83229c-a516-466b-9d69-4f10ae6c549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:58.941507 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83229c-a516-466b-9d69-4f10ae6c549e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:58.941853 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83229c-a516-466b-9d69-4f10ae6c549e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:58.942164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83229c-a516-466b-9d69-4f10ae6c549e admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:58.943003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83229c-a516-466b-9d69-4f10ae6c549e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:11:58.943356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83229c-a516-466b-9d69-4f10ae6c549e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:58.947224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83229c-a516-466b-9d69-4f10ae6c549e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:58.975795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1142/2302] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:11:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:11:58.980247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadba85f-1e2d-4906-893c-6ec3ad1a37f3 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:58.996057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadba85f-1e2d-4906-893c-6ec3ad1a37f3 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:59.010583 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eb53f-559e-486c-9e8b-3c791e9f6b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:59.011334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eb53f-559e-486c-9e8b-3c791e9f6b3e admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:59.011611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eb53f-559e-486c-9e8b-3c791e9f6b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:59.011881 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73eb53f-559e-486c-9e8b-3c791e9f6b3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:59.012538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eb53f-559e-486c-9e8b-3c791e9f6b3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:59.014475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73eb53f-559e-486c-9e8b-3c791e9f6b3e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:59.087433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1161/2303] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:11:58 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:11:59.089789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83229c-a516-466b-9d69-4f10ae6c549e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:59.107010 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83229c-a516-466b-9d69-4f10ae6c549e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:59.206000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d9045-d829-4786-bdd1-df6fb2dc6331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:59.207005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d9045-d829-4786-bdd1-df6fb2dc6331 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:59.207789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d9045-d829-4786-bdd1-df6fb2dc6331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:59.208209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4d9045-d829-4786-bdd1-df6fb2dc6331 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:59.209075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d9045-d829-4786-bdd1-df6fb2dc6331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:59.217863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4d9045-d829-4786-bdd1-df6fb2dc6331 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:59.287121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1143/2304] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:11:59 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:11:59.290081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eb53f-559e-486c-9e8b-3c791e9f6b3e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:59.309343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73eb53f-559e-486c-9e8b-3c791e9f6b3e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:59.317195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2160f-a873-410c-8250-d654a499b54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:59.318639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2160f-a873-410c-8250-d654a499b54d admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:59.319576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2160f-a873-410c-8250-d654a499b54d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:59.321492 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d2160f-a873-410c-8250-d654a499b54d admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:59.322489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2160f-a873-410c-8250-d654a499b54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:59.329664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d2160f-a873-410c-8250-d654a499b54d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:59.345547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1162/2305] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:11:59.349763 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d9045-d829-4786-bdd1-df6fb2dc6331 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:59.361992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4d9045-d829-4786-bdd1-df6fb2dc6331 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:59.367867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14670a-4e73-4f20-a9e1-b68cab94de3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:59.368613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14670a-4e73-4f20-a9e1-b68cab94de3a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:59.368886 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14670a-4e73-4f20-a9e1-b68cab94de3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:59.369155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14670a-4e73-4f20-a9e1-b68cab94de3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:59.369811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14670a-4e73-4f20-a9e1-b68cab94de3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:59.371567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14670a-4e73-4f20-a9e1-b68cab94de3a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:59.392920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1144/2306] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:11:59 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:11:59.397870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2160f-a873-410c-8250-d654a499b54d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:59.412212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d2160f-a873-410c-8250-d654a499b54d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:59.434998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72461a8-b2e3-4fdf-adc2-04fa31b6bf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:59.435790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72461a8-b2e3-4fdf-adc2-04fa31b6bf74 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:59.436129 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72461a8-b2e3-4fdf-adc2-04fa31b6bf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:59.436658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72461a8-b2e3-4fdf-adc2-04fa31b6bf74 admin admin] PATH_INFO: `/v3/projects/7a31fddb4ddd4b06a22011aed4fdc843/users/b1c2ceec126e41d69b2445945b6b19ee/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:59.482982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72461a8-b2e3-4fdf-adc2-04fa31b6bf74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a31fddb4ddd4b06a22011aed4fdc843, user_id=b1c2ceec126e41d69b2445945b6b19ee, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:59.486397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72461a8-b2e3-4fdf-adc2-04fa31b6bf74 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:59.508132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1163/2307] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:11:59 2022] PUT /identity/v3/projects/7a31fddb4ddd4b06a22011aed4fdc843/users/b1c2ceec126e41d69b2445945b6b19ee/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:11:59.522102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478da9c9-a5bf-4e2e-aa95-d2cc2856f519 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:59.522444 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478da9c9-a5bf-4e2e-aa95-d2cc2856f519 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:59.522690 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478da9c9-a5bf-4e2e-aa95-d2cc2856f519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:59.560353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-478da9c9-a5bf-4e2e-aa95-d2cc2856f519 None None] MFA Rules not processed for user `b1c2ceec126e41d69b2445945b6b19ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:11:59.561662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-478da9c9-a5bf-4e2e-aa95-d2cc2856f519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:11:59.661806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72461a8-b2e3-4fdf-adc2-04fa31b6bf74 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:59.667012 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1145/2308] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:11:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:11:59.809361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72461a8-b2e3-4fdf-adc2-04fa31b6bf74 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:59.838027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205613-7893-4438-ab36-41aec9acfb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:11:59.839279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205613-7893-4438-ab36-41aec9acfb5a admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:11:59.839657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205613-7893-4438-ab36-41aec9acfb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:11:59.840170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5205613-7893-4438-ab36-41aec9acfb5a admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:11:59.841972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205613-7893-4438-ab36-41aec9acfb5a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:11:59.849545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5205613-7893-4438-ab36-41aec9acfb5a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:11:59.930884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1164/2309] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:11:59 2022] POST /identity/v3/projects => generated 387 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:11:59.935936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478da9c9-a5bf-4e2e-aa95-d2cc2856f519 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:11:59.954612 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478da9c9-a5bf-4e2e-aa95-d2cc2856f519 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:11:59.975092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:00.050656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6bef8-7fea-4482-90df-c83e0a6dfc91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:00.051566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6bef8-7fea-4482-90df-c83e0a6dfc91 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:00.051844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6bef8-7fea-4482-90df-c83e0a6dfc91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:00.052114 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d6bef8-7fea-4482-90df-c83e0a6dfc91 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:00.052760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6bef8-7fea-4482-90df-c83e0a6dfc91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:00.054795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d6bef8-7fea-4482-90df-c83e0a6dfc91 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:00.095713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1146/2310] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:11:59 2022] POST /identity/v3/users => generated 300 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:00.102487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205613-7893-4438-ab36-41aec9acfb5a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:00.117189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5205613-7893-4438-ab36-41aec9acfb5a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:00.122913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbe947-992d-4b56-a553-e7b35c7a05ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:00.123690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbe947-992d-4b56-a553-e7b35c7a05ad admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:00.124085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbe947-992d-4b56-a553-e7b35c7a05ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:00.124690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbe947-992d-4b56-a553-e7b35c7a05ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:00.125626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbe947-992d-4b56-a553-e7b35c7a05ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:00.127603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbe947-992d-4b56-a553-e7b35c7a05ad admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:00.154426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1165/2311] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:00.154580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6bef8-7fea-4482-90df-c83e0a6dfc91 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:00.169173 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d6bef8-7fea-4482-90df-c83e0a6dfc91 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:00.174526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4848e-0d04-4414-982d-e8ad695e3662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:00.185223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4848e-0d04-4414-982d-e8ad695e3662 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:00.185590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4848e-0d04-4414-982d-e8ad695e3662 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:00.185939 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a4848e-0d04-4414-982d-e8ad695e3662 admin admin] PATH_INFO: `/v3/projects/6661243d616c4a05ba5303e0432536aa/users/c9194e79f2f34d96a5a0fac2569511cf/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:00.211933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4848e-0d04-4414-982d-e8ad695e3662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6661243d616c4a05ba5303e0432536aa, user_id=c9194e79f2f34d96a5a0fac2569511cf, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:00.215027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a4848e-0d04-4414-982d-e8ad695e3662 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:00.242649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1147/2312] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:00 2022] PUT /identity/v3/projects/6661243d616c4a05ba5303e0432536aa/users/c9194e79f2f34d96a5a0fac2569511cf/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:12:00.246650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbe947-992d-4b56-a553-e7b35c7a05ad admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:00.259162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbe947-992d-4b56-a553-e7b35c7a05ad admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:00.274511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:00.382491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcc69f1-b00e-419b-8e85-330fcc9e47bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:00.383247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc69f1-b00e-419b-8e85-330fcc9e47bd admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:00.383413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc69f1-b00e-419b-8e85-330fcc9e47bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:00.383867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcc69f1-b00e-419b-8e85-330fcc9e47bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:00.384685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc69f1-b00e-419b-8e85-330fcc9e47bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:00.386928 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcc69f1-b00e-419b-8e85-330fcc9e47bd admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:00.402946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1166/2313] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:00 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:00.404809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4848e-0d04-4414-982d-e8ad695e3662 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:00.419792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a4848e-0d04-4414-982d-e8ad695e3662 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:00.427453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8804-821f-48ad-86b4-51e15e4a5a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:00.428312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8804-821f-48ad-86b4-51e15e4a5a1f admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:00.428895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8804-821f-48ad-86b4-51e15e4a5a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:00.429384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c8804-821f-48ad-86b4-51e15e4a5a1f admin admin] PATH_INFO: `/v3/projects/6661243d616c4a05ba5303e0432536aa/users/c9194e79f2f34d96a5a0fac2569511cf/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:00.432684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c8804-821f-48ad-86b4-51e15e4a5a1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6661243d616c4a05ba5303e0432536aa, user_id=c9194e79f2f34d96a5a0fac2569511cf, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:00.435661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c8804-821f-48ad-86b4-51e15e4a5a1f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:00.461123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1148/2314] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:00 2022] PUT /identity/v3/projects/6661243d616c4a05ba5303e0432536aa/users/c9194e79f2f34d96a5a0fac2569511cf/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:00.463877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4edc1-e244-4720-80b2-59abe1684f1e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:00.464118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4edc1-e244-4720-80b2-59abe1684f1e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:00.464401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f4edc1-e244-4720-80b2-59abe1684f1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:00.500399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-94f4edc1-e244-4720-80b2-59abe1684f1e None None] MFA Rules not processed for user `c9194e79f2f34d96a5a0fac2569511cf`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:00.501506 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-94f4edc1-e244-4720-80b2-59abe1684f1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:00.606931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1167/2315] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:00.631958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8804-821f-48ad-86b4-51e15e4a5a1f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:00.634727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-612c8804-821f-48ad-86b4-51e15e4a5a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:00.763745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c8804-821f-48ad-86b4-51e15e4a5a1f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:00.772165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658f385-bb0f-4dad-9417-c4b292e066bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:00.773101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f385-bb0f-4dad-9417-c4b292e066bb service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:00.773556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f385-bb0f-4dad-9417-c4b292e066bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:00.774148 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658f385-bb0f-4dad-9417-c4b292e066bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:00.796585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658f385-bb0f-4dad-9417-c4b292e066bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:00.798928 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6658f385-bb0f-4dad-9417-c4b292e066bb service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:00.813755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1149/2316] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:12:00.893161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4edc1-e244-4720-80b2-59abe1684f1e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:01.001558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f4edc1-e244-4720-80b2-59abe1684f1e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:01.008035 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:01.008699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:01.008981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:01.009302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] PATH_INFO: `/v3/users/b1c2ceec126e41d69b2445945b6b19ee` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:01.011879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c2ceec126e41d69b2445945b6b19ee)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:01.021801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:01.110621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:01.126872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c2ceec126e41d69b2445945b6b19ee'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:01.154863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c2ceec126e41d69b2445945b6b19ee'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:01.184556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c2ceec126e41d69b2445945b6b19ee'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:01.193641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c2ceec126e41d69b2445945b6b19ee'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:01.196524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c2ceec126e41d69b2445945b6b19ee'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:01.212124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1168/2317] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:12:00 2022] DELETE /identity/v3/users/b1c2ceec126e41d69b2445945b6b19ee => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:01.217246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ca405-fb0d-4e0b-8716-57773d594045 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:01.217718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ca405-fb0d-4e0b-8716-57773d594045 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:01.218140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1ca405-fb0d-4e0b-8716-57773d594045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:01.254099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3b1ca405-fb0d-4e0b-8716-57773d594045 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:01.255630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3b1ca405-fb0d-4e0b-8716-57773d594045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:01.390662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1150/2318] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:01.411050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:01.412538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:01.483300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4dfbe42-152f-4528-8343-a19ea4da79a1 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:01.487778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b992e91-f051-4c9e-b5ff-1ea3cfe8b0b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:01.489132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b992e91-f051-4c9e-b5ff-1ea3cfe8b0b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:01.489855 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b992e91-f051-4c9e-b5ff-1ea3cfe8b0b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:01.490294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b992e91-f051-4c9e-b5ff-1ea3cfe8b0b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:01.503980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b992e91-f051-4c9e-b5ff-1ea3cfe8b0b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:01.506860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b992e91-f051-4c9e-b5ff-1ea3cfe8b0b6 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:01.519753 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1169/2319] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:12:02.742328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ca405-fb0d-4e0b-8716-57773d594045 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:02.745118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3b1ca405-fb0d-4e0b-8716-57773d594045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:02.763160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1ca405-fb0d-4e0b-8716-57773d594045 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:02.787546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:02.788453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:02.788792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:02.789079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] PATH_INFO: `/v3/projects/7a31fddb4ddd4b06a22011aed4fdc843` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:02.791184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a31fddb4ddd4b06a22011aed4fdc843)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:02.793473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:02.803193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:02.867392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a31fddb4ddd4b06a22011aed4fdc843', 'request_id': 'req-320c5448-a41c-4a91-a2cf-00e9744f310c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:02.876044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a31fddb4ddd4b06a22011aed4fdc843', 'request_id': 'req-320c5448-a41c-4a91-a2cf-00e9744f310c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:02.884328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a31fddb4ddd4b06a22011aed4fdc843', 'request_id': 'req-320c5448-a41c-4a91-a2cf-00e9744f310c'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:02.898350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] The token cache is being invalidate because project 7a31fddb4ddd4b06a22011aed4fdc843 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:02.898619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:02.899368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:02.902865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1151/2320] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:02 2022] DELETE /identity/v3/projects/7a31fddb4ddd4b06a22011aed4fdc843 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:02.905171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b992e91-f051-4c9e-b5ff-1ea3cfe8b0b6 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:02.920882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b992e91-f051-4c9e-b5ff-1ea3cfe8b0b6 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:03.009584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:03.010361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:03.011016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:03.011400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] PATH_INFO: `/v3/users/c9194e79f2f34d96a5a0fac2569511cf` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:03.012781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9194e79f2f34d96a5a0fac2569511cf)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:03.017366 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:03.108764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9194e79f2f34d96a5a0fac2569511cf'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:03.128175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:03.133714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9194e79f2f34d96a5a0fac2569511cf'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:03.148102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9194e79f2f34d96a5a0fac2569511cf'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:03.158078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9194e79f2f34d96a5a0fac2569511cf'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:03.158977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f9038440-d0a7-4f72-a01c-2d5bec034af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9194e79f2f34d96a5a0fac2569511cf'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:03.166945 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1170/2321] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:12:02 2022] DELETE /identity/v3/users/c9194e79f2f34d96a5a0fac2569511cf => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:04.097344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:04.098949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:04.117063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320c5448-a41c-4a91-a2cf-00e9744f310c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:04.195146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:04.195905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:04.196246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:04.196585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] PATH_INFO: `/v3/projects/6661243d616c4a05ba5303e0432536aa` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:04.197807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6661243d616c4a05ba5303e0432536aa)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:04.200052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:04.267084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6661243d616c4a05ba5303e0432536aa', 'request_id': 'req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:04.280096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6661243d616c4a05ba5303e0432536aa', 'request_id': 'req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:04.289672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6661243d616c4a05ba5303e0432536aa', 'request_id': 'req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:04.303192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] The token cache is being invalidate because project 6661243d616c4a05ba5303e0432536aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:04.303516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:04.304182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-640ff586-15fa-44a6-8ea5-5ef7fc5faef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:04.305972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1152/2322] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:04 2022] DELETE /identity/v3/projects/6661243d616c4a05ba5303e0432536aa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:04.310900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230304-09ab-448f-be89-cb04b8069f91 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:04.311409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230304-09ab-448f-be89-cb04b8069f91 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:04.311522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1230304-09ab-448f-be89-cb04b8069f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:04.332582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-b1230304-09ab-448f-be89-cb04b8069f91 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:04.333815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b1230304-09ab-448f-be89-cb04b8069f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:04.408883 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1171/2323] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:12:04.417790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4edc8a-3aee-4a10-afbd-00c1033716df None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:04.418072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4edc8a-3aee-4a10-afbd-00c1033716df None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:04.418515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4edc8a-3aee-4a10-afbd-00c1033716df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:04.444989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6d4edc8a-3aee-4a10-afbd-00c1033716df None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:04.446291 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6d4edc8a-3aee-4a10-afbd-00c1033716df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:04.454574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1153/2324] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:04.459636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1230304-09ab-448f-be89-cb04b8069f91 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:04.469937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1230304-09ab-448f-be89-cb04b8069f91 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:04.474975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ddd43-4795-401f-9966-81f012e9c7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:04.475734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ddd43-4795-401f-9966-81f012e9c7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:04.476120 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ddd43-4795-401f-9966-81f012e9c7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:04.476482 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ddd43-4795-401f-9966-81f012e9c7f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:04.477550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ddd43-4795-401f-9966-81f012e9c7f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:12:04.478283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ddd43-4795-401f-9966-81f012e9c7f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:04.480105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ddd43-4795-401f-9966-81f012e9c7f0 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:04.494142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1172/2325] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:12:04.498895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4edc8a-3aee-4a10-afbd-00c1033716df None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:04.517744 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4edc8a-3aee-4a10-afbd-00c1033716df None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:04.522885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1f0e4-eb35-454f-a782-038dce582ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:04.523655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1f0e4-eb35-454f-a782-038dce582ed9 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:04.524147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1f0e4-eb35-454f-a782-038dce582ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:04.524331 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b1f0e4-eb35-454f-a782-038dce582ed9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:04.525031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1f0e4-eb35-454f-a782-038dce582ed9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:04.527041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b1f0e4-eb35-454f-a782-038dce582ed9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:04.544649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:04.558377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1154/2326] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:04 2022] POST /identity/v3/projects => generated 381 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:04.562734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ddd43-4795-401f-9966-81f012e9c7f0 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:04.574275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ddd43-4795-401f-9966-81f012e9c7f0 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:04.637067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9b435-6424-4cf8-bc8a-f947b8261fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:04.637693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b435-6424-4cf8-bc8a-f947b8261fdd admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:04.637972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b435-6424-4cf8-bc8a-f947b8261fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:04.638244 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c9b435-6424-4cf8-bc8a-f947b8261fdd admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:04.638903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9b435-6424-4cf8-bc8a-f947b8261fdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:04.640867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c9b435-6424-4cf8-bc8a-f947b8261fdd admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:04.668216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1173/2327] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:04 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:04.669702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1f0e4-eb35-454f-a782-038dce582ed9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:04.680902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b1f0e4-eb35-454f-a782-038dce582ed9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:04.686200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341e910-810b-4e55-8b5c-e1f02438c818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:04.686969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341e910-810b-4e55-8b5c-e1f02438c818 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:04.687324 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341e910-810b-4e55-8b5c-e1f02438c818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:04.687666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2341e910-810b-4e55-8b5c-e1f02438c818 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:04.688550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341e910-810b-4e55-8b5c-e1f02438c818 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:04.690196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2341e910-810b-4e55-8b5c-e1f02438c818 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:04.701324 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1155/2328] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:04.705479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9b435-6424-4cf8-bc8a-f947b8261fdd admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:04.716336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c9b435-6424-4cf8-bc8a-f947b8261fdd admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:04.720925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008fe71-b24c-43ad-9b48-73b2aa11d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:04.721530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008fe71-b24c-43ad-9b48-73b2aa11d32c admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:04.721809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008fe71-b24c-43ad-9b48-73b2aa11d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:04.722081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008fe71-b24c-43ad-9b48-73b2aa11d32c admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:04.722793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008fe71-b24c-43ad-9b48-73b2aa11d32c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:04.724957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8008fe71-b24c-43ad-9b48-73b2aa11d32c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:04.735062 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1174/2329] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:12:04.739428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341e910-810b-4e55-8b5c-e1f02438c818 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:04.750029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2341e910-810b-4e55-8b5c-e1f02438c818 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:04.755740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c84c79-617b-4548-857d-a1f8eecaecd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:04.756652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c84c79-617b-4548-857d-a1f8eecaecd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:04.757056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c84c79-617b-4548-857d-a1f8eecaecd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:04.757348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c84c79-617b-4548-857d-a1f8eecaecd6 admin admin] PATH_INFO: `/v3/projects/cd6d8a13c8f04b4eaadad2d5dacc06a0/users/76b664548e384d50bee12e7b7db5e9df/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:04.774941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c84c79-617b-4548-857d-a1f8eecaecd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd6d8a13c8f04b4eaadad2d5dacc06a0, user_id=76b664548e384d50bee12e7b7db5e9df, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:04.778057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c84c79-617b-4548-857d-a1f8eecaecd6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:04.794288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1156/2330] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:04 2022] PUT /identity/v3/projects/cd6d8a13c8f04b4eaadad2d5dacc06a0/users/76b664548e384d50bee12e7b7db5e9df/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:04.809773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b40f-dc52-4d17-ab2d-50ffe01898bd None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:04.810160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b40f-dc52-4d17-ab2d-50ffe01898bd None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:04.810533 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7875b40f-dc52-4d17-ab2d-50ffe01898bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:04.852602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7875b40f-dc52-4d17-ab2d-50ffe01898bd None None] MFA Rules not processed for user `76b664548e384d50bee12e7b7db5e9df`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:04.856536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7875b40f-dc52-4d17-ab2d-50ffe01898bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:04.896996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:04.950672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1175/2331] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:04.951899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c84c79-617b-4548-857d-a1f8eecaecd6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:05.080595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c84c79-617b-4548-857d-a1f8eecaecd6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:05.091788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9053f-24ae-4887-872f-9965eb37ca0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:05.092434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9053f-24ae-4887-872f-9965eb37ca0d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:05.092714 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9053f-24ae-4887-872f-9965eb37ca0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:05.092990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c9053f-24ae-4887-872f-9965eb37ca0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:05.093784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9053f-24ae-4887-872f-9965eb37ca0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:05.095800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c9053f-24ae-4887-872f-9965eb37ca0d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:05.171941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1157/2332] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:04 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:05.176440 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875b40f-dc52-4d17-ab2d-50ffe01898bd None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:05.193389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7875b40f-dc52-4d17-ab2d-50ffe01898bd None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:05.309337 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ffbc7-9a9a-4473-82da-6b8bbd50870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:05.310138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ffbc7-9a9a-4473-82da-6b8bbd50870f admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:05.310704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ffbc7-9a9a-4473-82da-6b8bbd50870f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:05.311149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ffbc7-9a9a-4473-82da-6b8bbd50870f admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:05.312892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ffbc7-9a9a-4473-82da-6b8bbd50870f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:05.316302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98ffbc7-9a9a-4473-82da-6b8bbd50870f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:05.360693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1176/2333] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:05 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:05.367057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9053f-24ae-4887-872f-9965eb37ca0d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:05.380117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c9053f-24ae-4887-872f-9965eb37ca0d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:05.387662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9458d36-8321-4a78-aabd-144a33bd73a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:05.388490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9458d36-8321-4a78-aabd-144a33bd73a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:05.389419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9458d36-8321-4a78-aabd-144a33bd73a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:05.389849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9458d36-8321-4a78-aabd-144a33bd73a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:05.390681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9458d36-8321-4a78-aabd-144a33bd73a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:05.392877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9458d36-8321-4a78-aabd-144a33bd73a5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:05.411785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ffbc7-9a9a-4473-82da-6b8bbd50870f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:05.417897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1158/2334] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:05.424035 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98ffbc7-9a9a-4473-82da-6b8bbd50870f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:05.429434 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dbf61-db5b-4dae-907c-b705600852f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:05.430630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dbf61-db5b-4dae-907c-b705600852f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:05.430951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dbf61-db5b-4dae-907c-b705600852f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:05.431228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dbf61-db5b-4dae-907c-b705600852f6 admin admin] PATH_INFO: `/v3/projects/7eead04cfeff4c83b80aa0330c5a6e29/users/593b434ca77f403fa1c606adfbebf665/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:05.469069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565dbf61-db5b-4dae-907c-b705600852f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eead04cfeff4c83b80aa0330c5a6e29, user_id=593b434ca77f403fa1c606adfbebf665, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:05.475970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565dbf61-db5b-4dae-907c-b705600852f6 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:05.497322 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1177/2335] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:05 2022] PUT /identity/v3/projects/7eead04cfeff4c83b80aa0330c5a6e29/users/593b434ca77f403fa1c606adfbebf665/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:05.501301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9458d36-8321-4a78-aabd-144a33bd73a5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:05.513474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9458d36-8321-4a78-aabd-144a33bd73a5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:05.609788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a4c2a-af2b-4b71-89eb-3db8e03309cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:05.610419 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a4c2a-af2b-4b71-89eb-3db8e03309cd admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:05.611327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a4c2a-af2b-4b71-89eb-3db8e03309cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:05.611524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a4c2a-af2b-4b71-89eb-3db8e03309cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:05.613458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a4c2a-af2b-4b71-89eb-3db8e03309cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:05.616012 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a4c2a-af2b-4b71-89eb-3db8e03309cd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:05.660198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1159/2336] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:05.666060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dbf61-db5b-4dae-907c-b705600852f6 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:05.686102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dbf61-db5b-4dae-907c-b705600852f6 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:05.691732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a66d7-5a7e-433a-af1e-72905e026f70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:05.693291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a66d7-5a7e-433a-af1e-72905e026f70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:05.693578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a66d7-5a7e-433a-af1e-72905e026f70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:05.694083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2a66d7-5a7e-433a-af1e-72905e026f70 admin admin] PATH_INFO: `/v3/projects/7eead04cfeff4c83b80aa0330c5a6e29/users/593b434ca77f403fa1c606adfbebf665/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:05.697158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a66d7-5a7e-433a-af1e-72905e026f70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eead04cfeff4c83b80aa0330c5a6e29, user_id=593b434ca77f403fa1c606adfbebf665, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:05.700293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2a66d7-5a7e-433a-af1e-72905e026f70 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:05.715809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1178/2337] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:05 2022] PUT /identity/v3/projects/7eead04cfeff4c83b80aa0330c5a6e29/users/593b434ca77f403fa1c606adfbebf665/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:05.726252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2d181-29a9-4f39-9d08-63b1cfc4db32 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:05.726485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2d181-29a9-4f39-9d08-63b1cfc4db32 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:05.726762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a2d181-29a9-4f39-9d08-63b1cfc4db32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:05.783315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-19a2d181-29a9-4f39-9d08-63b1cfc4db32 None None] MFA Rules not processed for user `593b434ca77f403fa1c606adfbebf665`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:05.784556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-19a2d181-29a9-4f39-9d08-63b1cfc4db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:05.814299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:05.897832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1160/2338] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:05.913634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a66d7-5a7e-433a-af1e-72905e026f70 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:05.918874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4b2a66d7-5a7e-433a-af1e-72905e026f70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:06.022801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2a66d7-5a7e-433a-af1e-72905e026f70 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:06.028144 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12940aa-28ef-4d38-9404-03700b3638f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:06.029667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12940aa-28ef-4d38-9404-03700b3638f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:06.030062 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12940aa-28ef-4d38-9404-03700b3638f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:06.030409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12940aa-28ef-4d38-9404-03700b3638f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:06.045788 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12940aa-28ef-4d38-9404-03700b3638f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:06.047460 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12940aa-28ef-4d38-9404-03700b3638f8 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:06.061363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1179/2339] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:12:06.064086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2d181-29a9-4f39-9d08-63b1cfc4db32 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:06.065571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-19a2d181-29a9-4f39-9d08-63b1cfc4db32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:06.144080 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a2d181-29a9-4f39-9d08-63b1cfc4db32 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:06.150416 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:06.151100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:06.151380 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:06.151654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] PATH_INFO: `/v3/users/d85456c1ecdd4286b3861d3c9d650f28` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:06.152818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d85456c1ecdd4286b3861d3c9d650f28)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:06.154870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:06.211724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd85456c1ecdd4286b3861d3c9d650f28'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.212429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd85456c1ecdd4286b3861d3c9d650f28'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.213126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd85456c1ecdd4286b3861d3c9d650f28'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.225618 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd85456c1ecdd4286b3861d3c9d650f28'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.234134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd85456c1ecdd4286b3861d3c9d650f28'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.247036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1161/2340] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:12:06 2022] DELETE /identity/v3/users/d85456c1ecdd4286b3861d3c9d650f28 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:12:06.420381 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12940aa-28ef-4d38-9404-03700b3638f8 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:06.432321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12940aa-28ef-4d38-9404-03700b3638f8 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:06.465653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:06.472786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:06.474695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:06.505424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9edca-e76e-48a2-838e-bbadc98c79ff tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '593b434ca77f403fa1c606adfbebf665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7eead04cfeff4c83b80aa0330c5a6e29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:06.507141 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9edca-e76e-48a2-838e-bbadc98c79ff tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:06.507408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9edca-e76e-48a2-838e-bbadc98c79ff tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:06.507688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a9edca-e76e-48a2-838e-bbadc98c79ff tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:06.508810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9edca-e76e-48a2-838e-bbadc98c79ff tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:12:06.509120 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9edca-e76e-48a2-838e-bbadc98c79ff tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:06.510808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a9edca-e76e-48a2-838e-bbadc98c79ff tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:06.528357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1180/2341] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:12:06.532551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:06.532724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9edca-e76e-48a2-838e-bbadc98c79ff tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:06.534666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-21a9edca-e76e-48a2-838e-bbadc98c79ff tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:06.549886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a9edca-e76e-48a2-838e-bbadc98c79ff tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:06.554844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5f7a-05d0-4bba-82e7-c1380609076b tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '593b434ca77f403fa1c606adfbebf665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7eead04cfeff4c83b80aa0330c5a6e29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:06.555625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5f7a-05d0-4bba-82e7-c1380609076b tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:06.556121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5f7a-05d0-4bba-82e7-c1380609076b tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:06.556599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5f7a-05d0-4bba-82e7-c1380609076b tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:06.557334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd5f7a-05d0-4bba-82e7-c1380609076b tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:06.559579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd5f7a-05d0-4bba-82e7-c1380609076b tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:06.567896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09df8a39-3b4b-4131-a9d0-dddc0b501f1a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:06.574925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:06.575967 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:06.576338 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:06.576722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] PATH_INFO: `/v3/projects/416da6ea029742d4be97ac818964fac8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:06.578300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=416da6ea029742d4be97ac818964fac8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:06.581028 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:06.599925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1181/2342] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:06 2022] POST /identity/v3/projects => generated 354 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:12:06.604553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5f7a-05d0-4bba-82e7-c1380609076b tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:06.637172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '416da6ea029742d4be97ac818964fac8', 'request_id': 'req-316b8863-a79a-4f2c-99d9-05a4867f0a2e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.649367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '416da6ea029742d4be97ac818964fac8', 'request_id': 'req-316b8863-a79a-4f2c-99d9-05a4867f0a2e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.656915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '416da6ea029742d4be97ac818964fac8', 'request_id': 'req-316b8863-a79a-4f2c-99d9-05a4867f0a2e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.669544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] The token cache is being invalidate because project 416da6ea029742d4be97ac818964fac8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:06.669832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.670499 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.672245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1162/2343] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:06 2022] DELETE /identity/v3/projects/416da6ea029742d4be97ac818964fac8 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:06.676024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:06.677483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:06.683424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5f7a-05d0-4bba-82e7-c1380609076b tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:06.746699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c250-4185-4ae8-a577-72d13a6f9598 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '593b434ca77f403fa1c606adfbebf665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7eead04cfeff4c83b80aa0330c5a6e29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:06.758994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c250-4185-4ae8-a577-72d13a6f9598 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:06.758994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c250-4185-4ae8-a577-72d13a6f9598 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:06.758994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf64c250-4185-4ae8-a577-72d13a6f9598 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:06.758994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c250-4185-4ae8-a577-72d13a6f9598 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:12:06.758994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c250-4185-4ae8-a577-72d13a6f9598 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:06.759530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316b8863-a79a-4f2c-99d9-05a4867f0a2e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:06.759635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf64c250-4185-4ae8-a577-72d13a6f9598 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:06.764429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:06.767050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1182/2344] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:12:06.767195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:06.767195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:06.767195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] PATH_INFO: `/v3/users/d56eb2bc21554244864f787b12eee84a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:06.767439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d56eb2bc21554244864f787b12eee84a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:06.769327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:06.805245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c250-4185-4ae8-a577-72d13a6f9598 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:06.807023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-cf64c250-4185-4ae8-a577-72d13a6f9598 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:06.819833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf64c250-4185-4ae8-a577-72d13a6f9598 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:06.824650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd56eb2bc21554244864f787b12eee84a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.825099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '593b434ca77f403fa1c606adfbebf665', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7eead04cfeff4c83b80aa0330c5a6e29', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:06.825508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd56eb2bc21554244864f787b12eee84a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.825747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:06.826030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:06.826150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd56eb2bc21554244864f787b12eee84a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.826304 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] PATH_INFO: `/v3/projects/b0095a87b9bd40cdab4ea238e329927e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:06.827547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b0095a87b9bd40cdab4ea238e329927e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:06.829497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:06.841662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd56eb2bc21554244864f787b12eee84a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.844337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:06.851694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd56eb2bc21554244864f787b12eee84a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.865885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1163/2345] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:12:06 2022] DELETE /identity/v3/users/d56eb2bc21554244864f787b12eee84a => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:12:06.872735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:06.883531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0095a87b9bd40cdab4ea238e329927e', 'request_id': 'req-96a2284b-e4fc-4cc7-afb1-c1041368df08'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.890134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0095a87b9bd40cdab4ea238e329927e', 'request_id': 'req-96a2284b-e4fc-4cc7-afb1-c1041368df08'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.899808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0095a87b9bd40cdab4ea238e329927e', 'request_id': 'req-96a2284b-e4fc-4cc7-afb1-c1041368df08'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.914101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] The token cache is being invalidate because project b0095a87b9bd40cdab4ea238e329927e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:06.914538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.918159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:06.925838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1183/2346] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:06 2022] DELETE /identity/v3/projects/b0095a87b9bd40cdab4ea238e329927e => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:12:07.068509 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:07.070164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:07.145458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af01de-8a77-40dc-8c59-45e625324829 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:07.163723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:07.165320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:07.205008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:07.205670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:07.205945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:07.206216 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] PATH_INFO: `/v3/projects/39183b890d1d48bf98c3784dacba2676` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:07.207433 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39183b890d1d48bf98c3784dacba2676)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:07.209369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:07.231796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2284b-e4fc-4cc7-afb1-c1041368df08 tempest-VolumeQuotaClassesTest-1803891740 tempest-VolumeQuotaClassesTest-1803891740-project-admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:07.237059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:07.237796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:07.238080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:07.238426 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] PATH_INFO: `/v3/users/76b664548e384d50bee12e7b7db5e9df` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:07.239888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] RBAC: Authorizing `identity:delete_user(user_id=76b664548e384d50bee12e7b7db5e9df)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:07.241983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:07.261563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39183b890d1d48bf98c3784dacba2676', 'request_id': 'req-c1122592-a899-4374-8b58-d939662284c7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:07.272823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39183b890d1d48bf98c3784dacba2676', 'request_id': 'req-c1122592-a899-4374-8b58-d939662284c7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:07.281078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39183b890d1d48bf98c3784dacba2676', 'request_id': 'req-c1122592-a899-4374-8b58-d939662284c7'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:07.293104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] The token cache is being invalidate because project 39183b890d1d48bf98c3784dacba2676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:07.293391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:07.294046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c1122592-a899-4374-8b58-d939662284c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:07.295702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1164/2347] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:07 2022] DELETE /identity/v3/projects/39183b890d1d48bf98c3784dacba2676 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:07.298336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76b664548e384d50bee12e7b7db5e9df'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:07.312067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76b664548e384d50bee12e7b7db5e9df'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:07.321386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76b664548e384d50bee12e7b7db5e9df'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:07.331393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76b664548e384d50bee12e7b7db5e9df'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:07.332433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76b664548e384d50bee12e7b7db5e9df'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:07.340672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1184/2348] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:12:07 2022] DELETE /identity/v3/users/76b664548e384d50bee12e7b7db5e9df => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:07.345611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81939916-1c38-424b-aa23-0d174bd8f469 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:07.345897 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81939916-1c38-424b-aa23-0d174bd8f469 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:07.346187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81939916-1c38-424b-aa23-0d174bd8f469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:07.367770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-81939916-1c38-424b-aa23-0d174bd8f469 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:07.369020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-81939916-1c38-424b-aa23-0d174bd8f469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:07.388608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:07.438416 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1165/2349] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:07.448852 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:07.450467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:07.504139 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:07.520201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba405e44-0836-4bbb-b7af-4b34adcc382a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:07.524974 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c95917-2de1-41c6-857a-40129e3ab8ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:07.525619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c95917-2de1-41c6-857a-40129e3ab8ff service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:07.525891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c95917-2de1-41c6-857a-40129e3ab8ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:07.526164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c95917-2de1-41c6-857a-40129e3ab8ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:07.537411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c95917-2de1-41c6-857a-40129e3ab8ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:07.538952 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c95917-2de1-41c6-857a-40129e3ab8ff service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:07.550058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1185/2350] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:12:07.923273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81939916-1c38-424b-aa23-0d174bd8f469 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:07.928890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-81939916-1c38-424b-aa23-0d174bd8f469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:07.959708 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81939916-1c38-424b-aa23-0d174bd8f469 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:07.968348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:07.969231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:07.969747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:07.970047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] PATH_INFO: `/v3/projects/cd6d8a13c8f04b4eaadad2d5dacc06a0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:07.971742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd6d8a13c8f04b4eaadad2d5dacc06a0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:07.974238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:08.050306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd6d8a13c8f04b4eaadad2d5dacc06a0', 'request_id': 'req-4917d673-d482-45eb-99d5-80f98212e25e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.060620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd6d8a13c8f04b4eaadad2d5dacc06a0', 'request_id': 'req-4917d673-d482-45eb-99d5-80f98212e25e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.069634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd6d8a13c8f04b4eaadad2d5dacc06a0', 'request_id': 'req-4917d673-d482-45eb-99d5-80f98212e25e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.088992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] The token cache is being invalidate because project cd6d8a13c8f04b4eaadad2d5dacc06a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:08.089403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.090485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.092092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1166/2351] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:07 2022] DELETE /identity/v3/projects/cd6d8a13c8f04b4eaadad2d5dacc06a0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:08.096279 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c95917-2de1-41c6-857a-40129e3ab8ff service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:08.106796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c95917-2de1-41c6-857a-40129e3ab8ff service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:08.168980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:08.169633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:08.169915 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:08.170186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] PATH_INFO: `/v3/users/593b434ca77f403fa1c606adfbebf665` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:08.171390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=593b434ca77f403fa1c606adfbebf665)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:08.173308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:08.223715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '593b434ca77f403fa1c606adfbebf665'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.235583 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '593b434ca77f403fa1c606adfbebf665'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.245684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '593b434ca77f403fa1c606adfbebf665'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.253643 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '593b434ca77f403fa1c606adfbebf665'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.254447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-92f14266-36e0-4b89-be15-f239ebecaa3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '593b434ca77f403fa1c606adfbebf665'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.260899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1186/2352] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:12:08 2022] DELETE /identity/v3/users/593b434ca77f403fa1c606adfbebf665 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:08.571906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:08.573420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:08.589273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917d673-d482-45eb-99d5-80f98212e25e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:08.649427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:08.649941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:08.650217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:08.650487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] PATH_INFO: `/v3/projects/7eead04cfeff4c83b80aa0330c5a6e29` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:08.651973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eead04cfeff4c83b80aa0330c5a6e29)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:08.653675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:08.709121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:08.710711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eead04cfeff4c83b80aa0330c5a6e29', 'request_id': 'req-1930a6c2-7097-4b8f-ad81-c937953a688f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.718977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eead04cfeff4c83b80aa0330c5a6e29', 'request_id': 'req-1930a6c2-7097-4b8f-ad81-c937953a688f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.726144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eead04cfeff4c83b80aa0330c5a6e29', 'request_id': 'req-1930a6c2-7097-4b8f-ad81-c937953a688f'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.737441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] The token cache is being invalidate because project 7eead04cfeff4c83b80aa0330c5a6e29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:08.737728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.738434 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-1930a6c2-7097-4b8f-ad81-c937953a688f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:08.740151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1167/2353] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:08 2022] DELETE /identity/v3/projects/7eead04cfeff4c83b80aa0330c5a6e29 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:08.745412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07366b-7182-4284-8bdb-67b5a3233c46 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:08.745895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07366b-7182-4284-8bdb-67b5a3233c46 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:08.745992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c07366b-7182-4284-8bdb-67b5a3233c46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:08.767208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-1c07366b-7182-4284-8bdb-67b5a3233c46 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:08.768425 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-1c07366b-7182-4284-8bdb-67b5a3233c46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:08.833440 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1187/2354] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:08.841694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010faa-2dce-432c-9372-1d6af9001ba7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:08.842051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010faa-2dce-432c-9372-1d6af9001ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:08.842412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a010faa-2dce-432c-9372-1d6af9001ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:08.863513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-1a010faa-2dce-432c-9372-1d6af9001ba7 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:08.864828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-1a010faa-2dce-432c-9372-1d6af9001ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:08.873672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1168/2355] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:08.878321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07366b-7182-4284-8bdb-67b5a3233c46 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:08.888465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c07366b-7182-4284-8bdb-67b5a3233c46 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:08.893500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eb22e-31b8-4e1e-a882-14e5dc86595e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:08.894089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eb22e-31b8-4e1e-a882-14e5dc86595e admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:08.894362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eb22e-31b8-4e1e-a882-14e5dc86595e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:08.894817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eb22e-31b8-4e1e-a882-14e5dc86595e admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:08.895343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eb22e-31b8-4e1e-a882-14e5dc86595e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:12:08.896297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eb22e-31b8-4e1e-a882-14e5dc86595e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:08.897235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eb22e-31b8-4e1e-a882-14e5dc86595e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:08.898865 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:08.912068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1188/2356] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:12:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:12:08.915319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a010faa-2dce-432c-9372-1d6af9001ba7 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:08.925293 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a010faa-2dce-432c-9372-1d6af9001ba7 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:08.930566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0195e-719e-4dda-8ef4-9533717bc096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:08.931242 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0195e-719e-4dda-8ef4-9533717bc096 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:08.931515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0195e-719e-4dda-8ef4-9533717bc096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:08.931780 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf0195e-719e-4dda-8ef4-9533717bc096 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:08.932432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0195e-719e-4dda-8ef4-9533717bc096 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:08.934440 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf0195e-719e-4dda-8ef4-9533717bc096 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:08.965409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1169/2357] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:08 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:08.970030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eb22e-31b8-4e1e-a882-14e5dc86595e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:08.982990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eb22e-31b8-4e1e-a882-14e5dc86595e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.041549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce1d7f-5461-4c68-89fc-ea8731c96d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.042162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce1d7f-5461-4c68-89fc-ea8731c96d05 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.042436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce1d7f-5461-4c68-89fc-ea8731c96d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.042702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ce1d7f-5461-4c68-89fc-ea8731c96d05 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.043353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce1d7f-5461-4c68-89fc-ea8731c96d05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.045253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ce1d7f-5461-4c68-89fc-ea8731c96d05 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.068884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1189/2358] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:08 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:09.073074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0195e-719e-4dda-8ef4-9533717bc096 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:09.085366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf0195e-719e-4dda-8ef4-9533717bc096 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.090585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032ed8f-ddcb-4e8f-8485-5f6bfb04c027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.091276 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032ed8f-ddcb-4e8f-8485-5f6bfb04c027 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.091552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032ed8f-ddcb-4e8f-8485-5f6bfb04c027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.091823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a032ed8f-ddcb-4e8f-8485-5f6bfb04c027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.092479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032ed8f-ddcb-4e8f-8485-5f6bfb04c027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.094134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a032ed8f-ddcb-4e8f-8485-5f6bfb04c027 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.105222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1170/2359] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:09.109105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce1d7f-5461-4c68-89fc-ea8731c96d05 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:09.119623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ce1d7f-5461-4c68-89fc-ea8731c96d05 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.124435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858dd1ec-6f99-450f-beaf-7ed664914989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.125120 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dd1ec-6f99-450f-beaf-7ed664914989 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.125388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dd1ec-6f99-450f-beaf-7ed664914989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.125658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858dd1ec-6f99-450f-beaf-7ed664914989 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.126328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dd1ec-6f99-450f-beaf-7ed664914989 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.127962 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858dd1ec-6f99-450f-beaf-7ed664914989 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.139810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1190/2360] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:09.143964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032ed8f-ddcb-4e8f-8485-5f6bfb04c027 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:09.155743 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a032ed8f-ddcb-4e8f-8485-5f6bfb04c027 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.162007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0acac-587a-4780-b760-2f1dcebdd480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.162871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0acac-587a-4780-b760-2f1dcebdd480 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.163383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0acac-587a-4780-b760-2f1dcebdd480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.163651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f0acac-587a-4780-b760-2f1dcebdd480 admin admin] PATH_INFO: `/v3/projects/f48a3aa7b872431ba97b8138af8c3f9c/users/48e469e480164f12bdd432887a0fe5fd/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.182331 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0acac-587a-4780-b760-2f1dcebdd480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f48a3aa7b872431ba97b8138af8c3f9c, user_id=48e469e480164f12bdd432887a0fe5fd, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.185802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f0acac-587a-4780-b760-2f1dcebdd480 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.202286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1171/2361] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:09 2022] PUT /identity/v3/projects/f48a3aa7b872431ba97b8138af8c3f9c/users/48e469e480164f12bdd432887a0fe5fd/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:09.214390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5f044-2f3f-4713-85f1-7fbe96c35f47 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.214947 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5f044-2f3f-4713-85f1-7fbe96c35f47 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.215438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb5f044-2f3f-4713-85f1-7fbe96c35f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.244440 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ffb5f044-2f3f-4713-85f1-7fbe96c35f47 None None] MFA Rules not processed for user `48e469e480164f12bdd432887a0fe5fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:09.245759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ffb5f044-2f3f-4713-85f1-7fbe96c35f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:09.312939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1191/2362] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:12:09.317574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0acac-587a-4780-b760-2f1dcebdd480 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:09.378431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f0acac-587a-4780-b760-2f1dcebdd480 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.384272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a088a0-4753-48da-91ae-edd2349f3b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.384857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a088a0-4753-48da-91ae-edd2349f3b80 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.385130 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a088a0-4753-48da-91ae-edd2349f3b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.385392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a088a0-4753-48da-91ae-edd2349f3b80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.386030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a088a0-4753-48da-91ae-edd2349f3b80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.387954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a088a0-4753-48da-91ae-edd2349f3b80 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.417892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1172/2363] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:09 2022] POST /identity/v3/projects => generated 379 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:12:09.421796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5f044-2f3f-4713-85f1-7fbe96c35f47 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:09.432641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb5f044-2f3f-4713-85f1-7fbe96c35f47 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.491059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dfd0b-49fe-4e34-9256-3adb74d59bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.491667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dfd0b-49fe-4e34-9256-3adb74d59bda admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.491946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dfd0b-49fe-4e34-9256-3adb74d59bda admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.492218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3dfd0b-49fe-4e34-9256-3adb74d59bda admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.492836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dfd0b-49fe-4e34-9256-3adb74d59bda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.494857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3dfd0b-49fe-4e34-9256-3adb74d59bda admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.503635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:09.518729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1192/2364] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:09 2022] POST /identity/v3/users => generated 290 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:09.523073 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a088a0-4753-48da-91ae-edd2349f3b80 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:09.533784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a088a0-4753-48da-91ae-edd2349f3b80 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.540950 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198dec8-8ef1-4b43-af21-13f449633e3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.541621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198dec8-8ef1-4b43-af21-13f449633e3e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.541896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198dec8-8ef1-4b43-af21-13f449633e3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.542168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198dec8-8ef1-4b43-af21-13f449633e3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.542842 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198dec8-8ef1-4b43-af21-13f449633e3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.544498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198dec8-8ef1-4b43-af21-13f449633e3e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.555715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1173/2365] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:09.561027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dfd0b-49fe-4e34-9256-3adb74d59bda admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:09.573231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3dfd0b-49fe-4e34-9256-3adb74d59bda admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.581156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400d1baf-d105-4aa1-9368-c3aaa6e8ffef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.582022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1baf-d105-4aa1-9368-c3aaa6e8ffef admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.582605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1baf-d105-4aa1-9368-c3aaa6e8ffef admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.582605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400d1baf-d105-4aa1-9368-c3aaa6e8ffef admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.583484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d1baf-d105-4aa1-9368-c3aaa6e8ffef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.586108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400d1baf-d105-4aa1-9368-c3aaa6e8ffef admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.599946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1193/2366] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:09.604313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198dec8-8ef1-4b43-af21-13f449633e3e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:09.615094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198dec8-8ef1-4b43-af21-13f449633e3e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.621019 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181884d8-3f8f-4e57-86d2-d86c375561a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.621696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181884d8-3f8f-4e57-86d2-d86c375561a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.621971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181884d8-3f8f-4e57-86d2-d86c375561a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.622242 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181884d8-3f8f-4e57-86d2-d86c375561a4 admin admin] PATH_INFO: `/v3/projects/763c9d7c84b14bf78c3d64ba67f423e9/users/229158ff7902402abfa2a40f9cb82cf8/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.637781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181884d8-3f8f-4e57-86d2-d86c375561a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=763c9d7c84b14bf78c3d64ba67f423e9, user_id=229158ff7902402abfa2a40f9cb82cf8, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.640487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181884d8-3f8f-4e57-86d2-d86c375561a4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.656325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1174/2367] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:09 2022] PUT /identity/v3/projects/763c9d7c84b14bf78c3d64ba67f423e9/users/229158ff7902402abfa2a40f9cb82cf8/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:09.667219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060566-5445-44e6-bee6-8abbf4554749 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.667531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060566-5445-44e6-bee6-8abbf4554749 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.667801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49060566-5445-44e6-bee6-8abbf4554749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.697791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-49060566-5445-44e6-bee6-8abbf4554749 None None] MFA Rules not processed for user `229158ff7902402abfa2a40f9cb82cf8`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:09.698997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-49060566-5445-44e6-bee6-8abbf4554749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:09.764720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1194/2368] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:09.769763 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181884d8-3f8f-4e57-86d2-d86c375561a4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:09.798358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:09.841631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181884d8-3f8f-4e57-86d2-d86c375561a4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.846560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c52606-1a8d-46be-a9e4-6f51b12aa52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.847206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c52606-1a8d-46be-a9e4-6f51b12aa52e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.847478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c52606-1a8d-46be-a9e4-6f51b12aa52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.848072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c52606-1a8d-46be-a9e4-6f51b12aa52e admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.848870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c52606-1a8d-46be-a9e4-6f51b12aa52e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.851022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c52606-1a8d-46be-a9e4-6f51b12aa52e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.881229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1175/2369] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:09 2022] POST /identity/v3/projects => generated 377 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:09.885422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060566-5445-44e6-bee6-8abbf4554749 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:09.897038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49060566-5445-44e6-bee6-8abbf4554749 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:09.963618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832af3-00cb-4ebf-bc03-90a197c9571a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:09.964562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832af3-00cb-4ebf-bc03-90a197c9571a admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:09.964841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832af3-00cb-4ebf-bc03-90a197c9571a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:09.965247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02832af3-00cb-4ebf-bc03-90a197c9571a admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:09.965899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832af3-00cb-4ebf-bc03-90a197c9571a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:09.967882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02832af3-00cb-4ebf-bc03-90a197c9571a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:09.996452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1195/2370] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:09 2022] POST /identity/v3/users => generated 295 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:10.000335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c52606-1a8d-46be-a9e4-6f51b12aa52e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:10.012684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c52606-1a8d-46be-a9e4-6f51b12aa52e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:10.020087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38606c8f-4a68-4a98-b3b9-6fb88078f88c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:10.021005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38606c8f-4a68-4a98-b3b9-6fb88078f88c admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:10.021453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38606c8f-4a68-4a98-b3b9-6fb88078f88c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:10.021879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38606c8f-4a68-4a98-b3b9-6fb88078f88c admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:10.022746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38606c8f-4a68-4a98-b3b9-6fb88078f88c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:10.024620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38606c8f-4a68-4a98-b3b9-6fb88078f88c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:10.038674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1176/2371] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:10.042883 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832af3-00cb-4ebf-bc03-90a197c9571a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:10.053652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02832af3-00cb-4ebf-bc03-90a197c9571a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:10.058885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258de4b-1d72-451e-aae2-eef106f53990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:10.059645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258de4b-1d72-451e-aae2-eef106f53990 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:10.059967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258de4b-1d72-451e-aae2-eef106f53990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:10.060289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7258de4b-1d72-451e-aae2-eef106f53990 admin admin] PATH_INFO: `/v3/projects/4b87a04750c4427f9651fa65af4fefce/users/eb0219cc6c874a809cb127656be86bbc/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:10.076505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258de4b-1d72-451e-aae2-eef106f53990 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b87a04750c4427f9651fa65af4fefce, user_id=eb0219cc6c874a809cb127656be86bbc, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:10.079346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7258de4b-1d72-451e-aae2-eef106f53990 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:10.098488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1196/2372] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:10 2022] PUT /identity/v3/projects/4b87a04750c4427f9651fa65af4fefce/users/eb0219cc6c874a809cb127656be86bbc/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:10.100401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38606c8f-4a68-4a98-b3b9-6fb88078f88c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:10.111138 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38606c8f-4a68-4a98-b3b9-6fb88078f88c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:10.176719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29f6bf3-a3cc-4e95-b40c-87774112723f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:10.177503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f6bf3-a3cc-4e95-b40c-87774112723f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:10.177825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f6bf3-a3cc-4e95-b40c-87774112723f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:10.178043 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29f6bf3-a3cc-4e95-b40c-87774112723f admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:10.179904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f6bf3-a3cc-4e95-b40c-87774112723f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:10.181623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29f6bf3-a3cc-4e95-b40c-87774112723f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:10.193908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1177/2373] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:10 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:10.198075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258de4b-1d72-451e-aae2-eef106f53990 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:10.208580 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7258de4b-1d72-451e-aae2-eef106f53990 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:10.213257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9a1b1-88ca-460f-bd84-1b854288cf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:10.213942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a1b1-88ca-460f-bd84-1b854288cf85 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:10.214219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a1b1-88ca-460f-bd84-1b854288cf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:10.214488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b9a1b1-88ca-460f-bd84-1b854288cf85 admin admin] PATH_INFO: `/v3/projects/4b87a04750c4427f9651fa65af4fefce/users/eb0219cc6c874a809cb127656be86bbc/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:10.216458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9a1b1-88ca-460f-bd84-1b854288cf85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b87a04750c4427f9651fa65af4fefce, user_id=eb0219cc6c874a809cb127656be86bbc, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:10.219189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b9a1b1-88ca-460f-bd84-1b854288cf85 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:10.232018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1197/2374] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:10 2022] PUT /identity/v3/projects/4b87a04750c4427f9651fa65af4fefce/users/eb0219cc6c874a809cb127656be86bbc/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:10.245450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40b85-1dcf-408d-ba25-11e4f438ace2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:10.245741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40b85-1dcf-408d-ba25-11e4f438ace2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:10.246005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e40b85-1dcf-408d-ba25-11e4f438ace2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:10.283030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-40e40b85-1dcf-408d-ba25-11e4f438ace2 None None] MFA Rules not processed for user `eb0219cc6c874a809cb127656be86bbc`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:10.284272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-40e40b85-1dcf-408d-ba25-11e4f438ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:10.358964 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1178/2375] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:10.371098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9a1b1-88ca-460f-bd84-1b854288cf85 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:10.373272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c2b9a1b1-88ca-460f-bd84-1b854288cf85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:10.415400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:10.466858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b9a1b1-88ca-460f-bd84-1b854288cf85 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:10.471353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0adbf-25f4-49e1-b1ef-5c5f0740e627 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:10.472057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0adbf-25f4-49e1-b1ef-5c5f0740e627 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:10.472795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0adbf-25f4-49e1-b1ef-5c5f0740e627 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:10.472795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0adbf-25f4-49e1-b1ef-5c5f0740e627 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:10.486184 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0adbf-25f4-49e1-b1ef-5c5f0740e627 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:10.487704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0adbf-25f4-49e1-b1ef-5c5f0740e627 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:10.501020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1198/2376] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:12:10.549352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e40b85-1dcf-408d-ba25-11e4f438ace2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:10.550918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-40e40b85-1dcf-408d-ba25-11e4f438ace2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:10.563278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e40b85-1dcf-408d-ba25-11e4f438ace2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:10.567323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746e01fc-e7eb-4c93-b06b-9c300a426810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:10.568278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e01fc-e7eb-4c93-b06b-9c300a426810 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:10.568559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e01fc-e7eb-4c93-b06b-9c300a426810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:10.568839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746e01fc-e7eb-4c93-b06b-9c300a426810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:10.583092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:10.635081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e01fc-e7eb-4c93-b06b-9c300a426810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:10.636528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746e01fc-e7eb-4c93-b06b-9c300a426810 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:10.646322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1179/2377] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:10 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:12:13.632847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0adbf-25f4-49e1-b1ef-5c5f0740e627 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:13.701478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0adbf-25f4-49e1-b1ef-5c5f0740e627 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:13.707732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:13.708391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:13.708672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:13.708943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] PATH_INFO: `/v3/users/48e469e480164f12bdd432887a0fe5fd` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:13.710630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48e469e480164f12bdd432887a0fe5fd)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:13.714543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:13.776930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48e469e480164f12bdd432887a0fe5fd'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:13.792964 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48e469e480164f12bdd432887a0fe5fd'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:13.801900 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48e469e480164f12bdd432887a0fe5fd'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:13.811820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48e469e480164f12bdd432887a0fe5fd'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:13.812668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48e469e480164f12bdd432887a0fe5fd'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:13.823979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1199/2378] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:12:13 2022] DELETE /identity/v3/users/48e469e480164f12bdd432887a0fe5fd => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:13.824801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdf2d8-c83c-42f2-8e0d-970504f7eed3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:13.825883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdf2d8-c83c-42f2-8e0d-970504f7eed3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:13.826980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bdf2d8-c83c-42f2-8e0d-970504f7eed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:13.848675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f1bdf2d8-c83c-42f2-8e0d-970504f7eed3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:13.849906 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f1bdf2d8-c83c-42f2-8e0d-970504f7eed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:13.929540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1180/2379] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:12:13.939520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:13.941428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:13.998736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:14.021649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9dd37d-b235-4510-abb8-60e511a04f97 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:14.032618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f5e64-83ca-47b2-ae30-0c89b44596a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:14.033448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f5e64-83ca-47b2-ae30-0c89b44596a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:14.033713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f5e64-83ca-47b2-ae30-0c89b44596a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:14.033980 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18f5e64-83ca-47b2-ae30-0c89b44596a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:14.060289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f5e64-83ca-47b2-ae30-0c89b44596a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:14.062157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18f5e64-83ca-47b2-ae30-0c89b44596a7 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:14.077168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1200/2380] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:12:14.540445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdf2d8-c83c-42f2-8e0d-970504f7eed3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:14.542508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f1bdf2d8-c83c-42f2-8e0d-970504f7eed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:14.566705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bdf2d8-c83c-42f2-8e0d-970504f7eed3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:14.573590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:14.575191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:14.575861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:14.576064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] PATH_INFO: `/v3/projects/f48a3aa7b872431ba97b8138af8c3f9c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:14.577725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f48a3aa7b872431ba97b8138af8c3f9c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:14.580156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:14.644008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f48a3aa7b872431ba97b8138af8c3f9c', 'request_id': 'req-de8ad191-9397-46f0-ac40-de2a5e5d9527'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:14.654023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f48a3aa7b872431ba97b8138af8c3f9c', 'request_id': 'req-de8ad191-9397-46f0-ac40-de2a5e5d9527'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:14.661661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f48a3aa7b872431ba97b8138af8c3f9c', 'request_id': 'req-de8ad191-9397-46f0-ac40-de2a5e5d9527'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:14.674526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] The token cache is being invalidate because project f48a3aa7b872431ba97b8138af8c3f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:14.674845 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:14.675520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:14.678101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1181/2381] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:14 2022] DELETE /identity/v3/projects/f48a3aa7b872431ba97b8138af8c3f9c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:14.681807 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f5e64-83ca-47b2-ae30-0c89b44596a7 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:14.692804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18f5e64-83ca-47b2-ae30-0c89b44596a7 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:14.749549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:14.750195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:14.750469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:14.750738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] PATH_INFO: `/v3/users/229158ff7902402abfa2a40f9cb82cf8` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:14.751887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=229158ff7902402abfa2a40f9cb82cf8)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:14.753806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:14.815853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '229158ff7902402abfa2a40f9cb82cf8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:14.828735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '229158ff7902402abfa2a40f9cb82cf8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:14.839219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '229158ff7902402abfa2a40f9cb82cf8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:14.847631 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '229158ff7902402abfa2a40f9cb82cf8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:14.848169 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '229158ff7902402abfa2a40f9cb82cf8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:14.854398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1201/2382] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:12:14 2022] DELETE /identity/v3/users/229158ff7902402abfa2a40f9cb82cf8 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:12:15.146467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:15.148101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:15.163166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8ad191-9397-46f0-ac40-de2a5e5d9527 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:15.207932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:15.229927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:15.230598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:15.230903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:15.231173 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] PATH_INFO: `/v3/projects/763c9d7c84b14bf78c3d64ba67f423e9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:15.232293 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=763c9d7c84b14bf78c3d64ba67f423e9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:15.234244 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:15.288302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '763c9d7c84b14bf78c3d64ba67f423e9', 'request_id': 'req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:15.296815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '763c9d7c84b14bf78c3d64ba67f423e9', 'request_id': 'req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:15.304098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '763c9d7c84b14bf78c3d64ba67f423e9', 'request_id': 'req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:15.315326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] The token cache is being invalidate because project 763c9d7c84b14bf78c3d64ba67f423e9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:15.315613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:15.316280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:15.318137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1182/2383] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:15 2022] DELETE /identity/v3/projects/763c9d7c84b14bf78c3d64ba67f423e9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:12:15.322432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:15.324225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:15.347410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d57ca1-9781-4e66-9636-1b6838095d91 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:15.404875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:15.406517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:15.415042 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:15.415748 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:15.416107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:15.416392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] PATH_INFO: `/v3/users/eb0219cc6c874a809cb127656be86bbc` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:15.417550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb0219cc6c874a809cb127656be86bbc)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:15.419591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:15.426997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:15.478381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ede88c-db82-41d1-b4f0-0a549fb2e7c5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:15.480159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb0219cc6c874a809cb127656be86bbc'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:15.482088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab6785b-fc88-462e-b9be-037be5b650a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:15.482704 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6785b-fc88-462e-b9be-037be5b650a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:15.483017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6785b-fc88-462e-b9be-037be5b650a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:15.483378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6785b-fc88-462e-b9be-037be5b650a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:15.485344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3ab6785b-fc88-462e-b9be-037be5b650a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:15.503484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb0219cc6c874a809cb127656be86bbc'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:15.514499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb0219cc6c874a809cb127656be86bbc'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:15.521982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb0219cc6c874a809cb127656be86bbc'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:15.522637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb0219cc6c874a809cb127656be86bbc'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:15.528512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1202/2384] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:12:15 2022] DELETE /identity/v3/users/eb0219cc6c874a809cb127656be86bbc => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:15.547242 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6785b-fc88-462e-b9be-037be5b650a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:15.548702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab6785b-fc88-462e-b9be-037be5b650a3 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:15.558187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1183/2385] 10.222.0.59 () {60 vars in 1396 bytes} [Thu Aug 18 21:12:15 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3264 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:12:15.901656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:15.903365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:15.975920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34119ae3-455f-4352-b6ed-62965aec613c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:15.980683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:15.981323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:15.981606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:15.981876 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] PATH_INFO: `/v3/projects/4b87a04750c4427f9651fa65af4fefce` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:15.983051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b87a04750c4427f9651fa65af4fefce)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:15.985015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:16.035560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b87a04750c4427f9651fa65af4fefce', 'request_id': 'req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:16.041645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b87a04750c4427f9651fa65af4fefce', 'request_id': 'req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:16.050971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b87a04750c4427f9651fa65af4fefce', 'request_id': 'req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:16.063249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] The token cache is being invalidate because project 4b87a04750c4427f9651fa65af4fefce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:16.063536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:16.064159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ac81ba3b-7bb0-40a9-8b29-11c6a0b38c4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:16.065656 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1203/2386] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:15 2022] DELETE /identity/v3/projects/4b87a04750c4427f9651fa65af4fefce => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:12:16.072128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34d3d1-4e10-49d6-a77c-9f35534ce5fc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:16.072397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34d3d1-4e10-49d6-a77c-9f35534ce5fc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:16.072669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b34d3d1-4e10-49d6-a77c-9f35534ce5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:16.092894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5b34d3d1-4e10-49d6-a77c-9f35534ce5fc None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:16.094112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5b34d3d1-4e10-49d6-a77c-9f35534ce5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:16.113697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:16.159345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1184/2387] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:16.226528 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63509873-d90a-41df-af0b-f8e180db35fb None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:16.227403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63509873-d90a-41df-af0b-f8e180db35fb None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:16.227403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63509873-d90a-41df-af0b-f8e180db35fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:16.248701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-63509873-d90a-41df-af0b-f8e180db35fb None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:16.250014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-63509873-d90a-41df-af0b-f8e180db35fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:16.260023 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1204/2388] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:16.264373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34d3d1-4e10-49d6-a77c-9f35534ce5fc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:16.276429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b34d3d1-4e10-49d6-a77c-9f35534ce5fc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:16.283016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f1760-a442-45e4-87dc-4476126da028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:16.283650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1760-a442-45e4-87dc-4476126da028 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:16.283915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1760-a442-45e4-87dc-4476126da028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:16.284186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986f1760-a442-45e4-87dc-4476126da028 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:16.284891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1760-a442-45e4-87dc-4476126da028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:12:16.285250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1760-a442-45e4-87dc-4476126da028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:16.288254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986f1760-a442-45e4-87dc-4476126da028 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:16.300867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1185/2389] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:12:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:12:16.305600 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63509873-d90a-41df-af0b-f8e180db35fb None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:16.315388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63509873-d90a-41df-af0b-f8e180db35fb None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:16.320943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e42018-4015-41b7-bd4a-ed49af1ff9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:16.321553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e42018-4015-41b7-bd4a-ed49af1ff9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:16.321828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e42018-4015-41b7-bd4a-ed49af1ff9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:16.322093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e42018-4015-41b7-bd4a-ed49af1ff9b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:16.322708 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e42018-4015-41b7-bd4a-ed49af1ff9b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:16.324745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e42018-4015-41b7-bd4a-ed49af1ff9b9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:16.330111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:16.355995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1205/2390] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:16 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:16.360251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f1760-a442-45e4-87dc-4476126da028 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:16.370969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986f1760-a442-45e4-87dc-4476126da028 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:16.437403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df63a0-329c-49b5-86ad-81203fd15305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:16.438161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df63a0-329c-49b5-86ad-81203fd15305 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:16.438564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df63a0-329c-49b5-86ad-81203fd15305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:16.438977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20df63a0-329c-49b5-86ad-81203fd15305 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:16.439834 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df63a0-329c-49b5-86ad-81203fd15305 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:16.442371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20df63a0-329c-49b5-86ad-81203fd15305 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:16.466760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1186/2391] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:16 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:16.470998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e42018-4015-41b7-bd4a-ed49af1ff9b9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:16.481779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e42018-4015-41b7-bd4a-ed49af1ff9b9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:16.486420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c7f0e-28e2-4bd9-8ffe-59021b9eb5aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:16.487060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7f0e-28e2-4bd9-8ffe-59021b9eb5aa admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:16.487339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7f0e-28e2-4bd9-8ffe-59021b9eb5aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:16.487602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5c7f0e-28e2-4bd9-8ffe-59021b9eb5aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:16.488249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c7f0e-28e2-4bd9-8ffe-59021b9eb5aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:16.489967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5c7f0e-28e2-4bd9-8ffe-59021b9eb5aa admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:16.500429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1206/2392] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:16.504346 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df63a0-329c-49b5-86ad-81203fd15305 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:16.517926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20df63a0-329c-49b5-86ad-81203fd15305 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:16.523513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc862a-c58a-46d3-b382-28886766d7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:16.524317 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc862a-c58a-46d3-b382-28886766d7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:16.524598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc862a-c58a-46d3-b382-28886766d7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:16.524922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc862a-c58a-46d3-b382-28886766d7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:16.525511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc862a-c58a-46d3-b382-28886766d7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:16.527273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc862a-c58a-46d3-b382-28886766d7fd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:16.540709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1187/2393] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:16 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:16.545335 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c7f0e-28e2-4bd9-8ffe-59021b9eb5aa admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:16.557473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5c7f0e-28e2-4bd9-8ffe-59021b9eb5aa admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:16.562216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057caa37-1ce0-49c3-8766-9cb68f33bfbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:16.562925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057caa37-1ce0-49c3-8766-9cb68f33bfbb admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:16.563202 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057caa37-1ce0-49c3-8766-9cb68f33bfbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:16.563462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057caa37-1ce0-49c3-8766-9cb68f33bfbb admin admin] PATH_INFO: `/v3/projects/706516e2ec6541a98a03a7038aa59395/users/aa80446732ad475ba7ad982695f9f50a/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:16.578751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057caa37-1ce0-49c3-8766-9cb68f33bfbb admin admin] RBAC: Authorizing `identity:create_grant(project_id=706516e2ec6541a98a03a7038aa59395, user_id=aa80446732ad475ba7ad982695f9f50a, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:16.581458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057caa37-1ce0-49c3-8766-9cb68f33bfbb admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:16.596429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1207/2394] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:16 2022] PUT /identity/v3/projects/706516e2ec6541a98a03a7038aa59395/users/aa80446732ad475ba7ad982695f9f50a/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:16.607776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ccd5-73a2-4700-81e1-d6982da4a4be None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:16.608151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ccd5-73a2-4700-81e1-d6982da4a4be None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:16.608526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9ccd5-73a2-4700-81e1-d6982da4a4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:16.638540 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-29d9ccd5-73a2-4700-81e1-d6982da4a4be None None] MFA Rules not processed for user `aa80446732ad475ba7ad982695f9f50a`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:16.639808 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-29d9ccd5-73a2-4700-81e1-d6982da4a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:16.709620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1188/2395] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:16.722303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057caa37-1ce0-49c3-8766-9cb68f33bfbb admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:16.724473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-057caa37-1ce0-49c3-8766-9cb68f33bfbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:16.800729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057caa37-1ce0-49c3-8766-9cb68f33bfbb admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:16.805016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563a350-b4d0-4ec6-8f46-dd952aa12204 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:16.805712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563a350-b4d0-4ec6-8f46-dd952aa12204 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:16.806057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563a350-b4d0-4ec6-8f46-dd952aa12204 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:16.806486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e563a350-b4d0-4ec6-8f46-dd952aa12204 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:16.815908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563a350-b4d0-4ec6-8f46-dd952aa12204 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:16.817834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e563a350-b4d0-4ec6-8f46-dd952aa12204 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:16.828663 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1208/2396] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:12:26.393488 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db7e61-a89e-44f4-98ab-9fa6aa916460 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:26.393979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db7e61-a89e-44f4-98ab-9fa6aa916460 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:26.394091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53db7e61-a89e-44f4-98ab-9fa6aa916460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:26.418605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-53db7e61-a89e-44f4-98ab-9fa6aa916460 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:26.419866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-53db7e61-a89e-44f4-98ab-9fa6aa916460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:26.435315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:26.484473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1189/2397] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:12:26 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:26.497109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563a350-b4d0-4ec6-8f46-dd952aa12204 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:26.498647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e563a350-b4d0-4ec6-8f46-dd952aa12204 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:26.575850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e563a350-b4d0-4ec6-8f46-dd952aa12204 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:26.581320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd6eb3-3199-49c8-9693-dc04525984f9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:26.581940 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6eb3-3199-49c8-9693-dc04525984f9 service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:26.582220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6eb3-3199-49c8-9693-dc04525984f9 service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:26.582493 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6eb3-3199-49c8-9693-dc04525984f9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:26.592694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd6eb3-3199-49c8-9693-dc04525984f9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:26.594360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd6eb3-3199-49c8-9693-dc04525984f9 service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:26.602676 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1209/2398] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:12:26 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:12:36.476427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=16 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:36.599271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=78,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:36.917914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db7e61-a89e-44f4-98ab-9fa6aa916460 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:36.984083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53db7e61-a89e-44f4-98ab-9fa6aa916460 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:36.989629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:36.990561 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:36.990883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:36.991158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] PATH_INFO: `/v3/users/aa80446732ad475ba7ad982695f9f50a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:36.992324 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa80446732ad475ba7ad982695f9f50a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:36.994247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:37.046054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa80446732ad475ba7ad982695f9f50a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:37.046673 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa80446732ad475ba7ad982695f9f50a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:37.047287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa80446732ad475ba7ad982695f9f50a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:37.060631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa80446732ad475ba7ad982695f9f50a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:37.071274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa80446732ad475ba7ad982695f9f50a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:37.084722 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1190/2399] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:12:36 2022] DELETE /identity/v3/users/aa80446732ad475ba7ad982695f9f50a => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:37.089359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a70747-45f9-43d8-9a61-c1f4f655f1d6 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:37.089647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a70747-45f9-43d8-9a61-c1f4f655f1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:37.089921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a70747-45f9-43d8-9a61-c1f4f655f1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:37.116293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-27a70747-45f9-43d8-9a61-c1f4f655f1d6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:37.117535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-27a70747-45f9-43d8-9a61-c1f4f655f1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:37.188986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1210/2400] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:37.199626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:37.201159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:37.262176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e49f7f-12ec-4fa0-9ac2-924dee03e56c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:37.269725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb889257-02a8-4e70-bcbd-d2dd2199c9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:37.271497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889257-02a8-4e70-bcbd-d2dd2199c9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:37.271914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889257-02a8-4e70-bcbd-d2dd2199c9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:37.272369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb889257-02a8-4e70-bcbd-d2dd2199c9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:37.287628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb889257-02a8-4e70-bcbd-d2dd2199c9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:37.289153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb889257-02a8-4e70-bcbd-d2dd2199c9e2 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:37.299586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1191/2401] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:12:37.656445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a70747-45f9-43d8-9a61-c1f4f655f1d6 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:37.658071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-27a70747-45f9-43d8-9a61-c1f4f655f1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:37.670558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a70747-45f9-43d8-9a61-c1f4f655f1d6 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:37.675814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:37.676464 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:37.676786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:37.677429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] PATH_INFO: `/v3/projects/706516e2ec6541a98a03a7038aa59395` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:37.678271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] RBAC: Authorizing `identity:delete_project(project_id=706516e2ec6541a98a03a7038aa59395)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:37.680246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:37.751383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706516e2ec6541a98a03a7038aa59395', 'request_id': 'req-7c13ad29-132e-46e8-806f-d574ff9ebb32'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:37.758164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706516e2ec6541a98a03a7038aa59395', 'request_id': 'req-7c13ad29-132e-46e8-806f-d574ff9ebb32'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:37.767888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706516e2ec6541a98a03a7038aa59395', 'request_id': 'req-7c13ad29-132e-46e8-806f-d574ff9ebb32'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:37.783894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] The token cache is being invalidate because project 706516e2ec6541a98a03a7038aa59395 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:12:37.784273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:37.785014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-7c13ad29-132e-46e8-806f-d574ff9ebb32 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:12:37.787020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1211/2402] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:12:37 2022] DELETE /identity/v3/projects/706516e2ec6541a98a03a7038aa59395 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:37.792095 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035483fb-658a-463c-8e35-ab75c2c0f455 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:37.792673 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035483fb-658a-463c-8e35-ab75c2c0f455 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:37.792777 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035483fb-658a-463c-8e35-ab75c2c0f455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:37.814106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-035483fb-658a-463c-8e35-ab75c2c0f455 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:37.815477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-035483fb-658a-463c-8e35-ab75c2c0f455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:37.836483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:37.887859 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1192/2403] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:37.897403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a876d-a70c-4499-8c82-5ebeaba9442c None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:37.897684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a876d-a70c-4499-8c82-5ebeaba9442c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:37.897954 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2a876d-a70c-4499-8c82-5ebeaba9442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:37.923027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-4c2a876d-a70c-4499-8c82-5ebeaba9442c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:37.924678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4c2a876d-a70c-4499-8c82-5ebeaba9442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:37.940479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1212/2404] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:37.945536 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035483fb-658a-463c-8e35-ab75c2c0f455 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:37.956153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035483fb-658a-463c-8e35-ab75c2c0f455 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:37.962186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97810d0-c36f-47fa-9547-8ca878593246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:37.962756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97810d0-c36f-47fa-9547-8ca878593246 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:37.963089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97810d0-c36f-47fa-9547-8ca878593246 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:37.963352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97810d0-c36f-47fa-9547-8ca878593246 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:37.964023 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97810d0-c36f-47fa-9547-8ca878593246 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:12:37.964321 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97810d0-c36f-47fa-9547-8ca878593246 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:37.965913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97810d0-c36f-47fa-9547-8ca878593246 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:37.978718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1193/2405] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:12:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:12:37.983307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a876d-a70c-4499-8c82-5ebeaba9442c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:37.992968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2a876d-a70c-4499-8c82-5ebeaba9442c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:37.999256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc60859-3e82-4386-bf06-77b237721eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:37.999859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc60859-3e82-4386-bf06-77b237721eef admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:38.000133 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc60859-3e82-4386-bf06-77b237721eef admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:38.000396 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc60859-3e82-4386-bf06-77b237721eef admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:38.001017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc60859-3e82-4386-bf06-77b237721eef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:38.002972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc60859-3e82-4386-bf06-77b237721eef admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:38.034477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1213/2406] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:12:37 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:38.039088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97810d0-c36f-47fa-9547-8ca878593246 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:38.049539 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97810d0-c36f-47fa-9547-8ca878593246 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:38.109894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faa948-d006-4b48-a9b8-b32d352cfce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:38.110502 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faa948-d006-4b48-a9b8-b32d352cfce9 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:38.110812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faa948-d006-4b48-a9b8-b32d352cfce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:38.111084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53faa948-d006-4b48-a9b8-b32d352cfce9 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:38.111712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53faa948-d006-4b48-a9b8-b32d352cfce9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:38.113658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53faa948-d006-4b48-a9b8-b32d352cfce9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:38.137233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1194/2407] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:12:38 2022] POST /identity/v3/users => generated 286 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:12:38.142031 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc60859-3e82-4386-bf06-77b237721eef admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:38.152823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc60859-3e82-4386-bf06-77b237721eef admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:38.158072 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711a795-a9a1-4c9e-b19b-3b4021659998 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:38.158670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a795-a9a1-4c9e-b19b-3b4021659998 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:38.159001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a795-a9a1-4c9e-b19b-3b4021659998 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:38.159267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1711a795-a9a1-4c9e-b19b-3b4021659998 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:38.159891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711a795-a9a1-4c9e-b19b-3b4021659998 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:38.161861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1711a795-a9a1-4c9e-b19b-3b4021659998 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:38.304378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1214/2408] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:38.308850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faa948-d006-4b48-a9b8-b32d352cfce9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:38.319869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53faa948-d006-4b48-a9b8-b32d352cfce9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:38.326029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c82fe62-47ad-4420-b50c-0016d5d72854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:38.326627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fe62-47ad-4420-b50c-0016d5d72854 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:38.326939 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fe62-47ad-4420-b50c-0016d5d72854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:38.327209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c82fe62-47ad-4420-b50c-0016d5d72854 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:38.327861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82fe62-47ad-4420-b50c-0016d5d72854 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:38.329483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c82fe62-47ad-4420-b50c-0016d5d72854 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:38.340584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1195/2409] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:12:38.344963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711a795-a9a1-4c9e-b19b-3b4021659998 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:38.355982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1711a795-a9a1-4c9e-b19b-3b4021659998 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:38.361677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d043ac3-2eb5-4769-b672-a1ed9cd84828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:38.362337 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d043ac3-2eb5-4769-b672-a1ed9cd84828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:38.362611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d043ac3-2eb5-4769-b672-a1ed9cd84828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:38.362924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d043ac3-2eb5-4769-b672-a1ed9cd84828 admin admin] PATH_INFO: `/v3/projects/7a01a0c1f6734b59a1885d647947c4b8/users/6a8a33c03e454797a294b156de57ead5/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:38.378683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d043ac3-2eb5-4769-b672-a1ed9cd84828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a01a0c1f6734b59a1885d647947c4b8, user_id=6a8a33c03e454797a294b156de57ead5, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:38.381480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d043ac3-2eb5-4769-b672-a1ed9cd84828 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:38.398492 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1215/2410] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:12:38 2022] PUT /identity/v3/projects/7a01a0c1f6734b59a1885d647947c4b8/users/6a8a33c03e454797a294b156de57ead5/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:12:38.409209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee77fdd-d8b0-479b-b5df-1caa7e698fa7 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:38.409500 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee77fdd-d8b0-479b-b5df-1caa7e698fa7 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:38.409774 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee77fdd-d8b0-479b-b5df-1caa7e698fa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:38.439403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5ee77fdd-d8b0-479b-b5df-1caa7e698fa7 None None] MFA Rules not processed for user `6a8a33c03e454797a294b156de57ead5`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:38.440626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5ee77fdd-d8b0-479b-b5df-1caa7e698fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:38.511000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1196/2411] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:12:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:38.523539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d043ac3-2eb5-4769-b672-a1ed9cd84828 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:38.525268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5d043ac3-2eb5-4769-b672-a1ed9cd84828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:38.549349 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:38.588607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d043ac3-2eb5-4769-b672-a1ed9cd84828 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:38.592290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffe899-f1c8-480a-9630-c94a1eb572ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7074acac73904bab8399f223bd662863', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:38.593049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffe899-f1c8-480a-9630-c94a1eb572ad service glance] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:38.593182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffe899-f1c8-480a-9630-c94a1eb572ad service glance] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:38.593458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ffe899-f1c8-480a-9630-c94a1eb572ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:38.602324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffe899-f1c8-480a-9630-c94a1eb572ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:38.603815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ffe899-f1c8-480a-9630-c94a1eb572ad service glance] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:38.613002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1216/2412] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:12:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:12:42.125963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8985a-7a79-4e0c-ae34-64ea72d6d2a2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:42.126462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8985a-7a79-4e0c-ae34-64ea72d6d2a2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:42.126553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed8985a-7a79-4e0c-ae34-64ea72d6d2a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:42.149384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3ed8985a-7a79-4e0c-ae34-64ea72d6d2a2 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:12:42.150613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3ed8985a-7a79-4e0c-ae34-64ea72d6d2a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:42.165107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:42.220846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1197/2413] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:12:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:12:42.233716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffe899-f1c8-480a-9630-c94a1eb572ad service glance] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:12:42.235305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e3ffe899-f1c8-480a-9630-c94a1eb572ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:12:42.328291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ffe899-f1c8-480a-9630-c94a1eb572ad service glance] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:12:42.333422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449f72a-cfb3-461f-ba73-9f09494b3f72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:12:42.334159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449f72a-cfb3-461f-ba73-9f09494b3f72 service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:12:42.335009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449f72a-cfb3-461f-ba73-9f09494b3f72 service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:12:42.335288 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3449f72a-cfb3-461f-ba73-9f09494b3f72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:12:42.344195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449f72a-cfb3-461f-ba73-9f09494b3f72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:12:42.346275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3449f72a-cfb3-461f-ba73-9f09494b3f72 service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:12:42.356404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1217/2414] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:12:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:12:52.209156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=17 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:12:52.352603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=49 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:10.348456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b867-5fe7-472e-b2cc-aafd65fb54a0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.349039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b867-5fe7-472e-b2cc-aafd65fb54a0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.349039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe5b867-5fe7-472e-b2cc-aafd65fb54a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.377046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-bbe5b867-5fe7-472e-b2cc-aafd65fb54a0 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:10.378585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bbe5b867-5fe7-472e-b2cc-aafd65fb54a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:10.387134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1198/2415] 10.222.0.59 () {58 vars in 967 bytes} [Thu Aug 18 21:13:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:10.411939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449f72a-cfb3-461f-ba73-9f09494b3f72 service swift] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:10.422616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3449f72a-cfb3-461f-ba73-9f09494b3f72 service swift] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:10.427654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557095a5-182f-402a-aeb1-f591bd68f300 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:10.428245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557095a5-182f-402a-aeb1-f591bd68f300 service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:10.428523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557095a5-182f-402a-aeb1-f591bd68f300 service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:10.428779 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557095a5-182f-402a-aeb1-f591bd68f300 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:10.444100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557095a5-182f-402a-aeb1-f591bd68f300 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:10.445713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557095a5-182f-402a-aeb1-f591bd68f300 service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:10.462496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1218/2416] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:13:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:13:18.188051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5b867-5fe7-472e-b2cc-aafd65fb54a0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:18.252072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe5b867-5fe7-472e-b2cc-aafd65fb54a0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:18.257527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:18.258146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:18.258423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:18.258692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] PATH_INFO: `/v3/users/6a8a33c03e454797a294b156de57ead5` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:18.259889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a8a33c03e454797a294b156de57ead5)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:18.261805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:18.324304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a8a33c03e454797a294b156de57ead5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:18.325377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a8a33c03e454797a294b156de57ead5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:18.326455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a8a33c03e454797a294b156de57ead5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:18.344215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a8a33c03e454797a294b156de57ead5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:18.354453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a8a33c03e454797a294b156de57ead5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:18.367502 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1199/2417] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:18 2022] DELETE /identity/v3/users/6a8a33c03e454797a294b156de57ead5 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:18.373612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf743e-2004-4df6-84cc-0918a17f3158 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:18.374108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf743e-2004-4df6-84cc-0918a17f3158 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:18.374208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bf743e-2004-4df6-84cc-0918a17f3158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:18.395998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-e5bf743e-2004-4df6-84cc-0918a17f3158 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:18.397199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e5bf743e-2004-4df6-84cc-0918a17f3158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:18.457372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1219/2418] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:18.471021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:18.473333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:18.535175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a740-b6da-4ae0-9e25-fb8e94cc292c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:18.539895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faafa85-cf19-4f00-99fd-c0e38831bd11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:18.540492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faafa85-cf19-4f00-99fd-c0e38831bd11 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:18.540762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faafa85-cf19-4f00-99fd-c0e38831bd11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:18.541047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faafa85-cf19-4f00-99fd-c0e38831bd11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:18.551149 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faafa85-cf19-4f00-99fd-c0e38831bd11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:18.552588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faafa85-cf19-4f00-99fd-c0e38831bd11 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:18.562087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1200/2419] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:18.844484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf743e-2004-4df6-84cc-0918a17f3158 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:18.845899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e5bf743e-2004-4df6-84cc-0918a17f3158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:18.858259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5bf743e-2004-4df6-84cc-0918a17f3158 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:18.863227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:18.863943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:18.864298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:18.864965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] PATH_INFO: `/v3/projects/7a01a0c1f6734b59a1885d647947c4b8` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:18.866302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a01a0c1f6734b59a1885d647947c4b8)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:18.868511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:18.930833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a01a0c1f6734b59a1885d647947c4b8', 'request_id': 'req-c397983e-60ad-4ef6-903c-334ad1871de5'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:18.936232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a01a0c1f6734b59a1885d647947c4b8', 'request_id': 'req-c397983e-60ad-4ef6-903c-334ad1871de5'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:18.944796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a01a0c1f6734b59a1885d647947c4b8', 'request_id': 'req-c397983e-60ad-4ef6-903c-334ad1871de5'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:18.956882 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] The token cache is being invalidate because project 7a01a0c1f6734b59a1885d647947c4b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:18.957171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:18.957893 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:18.959570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1220/2420] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:18 2022] DELETE /identity/v3/projects/7a01a0c1f6734b59a1885d647947c4b8 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:28.558032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=82,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:28.953639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=60,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:44.416925 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faafa85-cf19-4f00-99fd-c0e38831bd11 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:44.419224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5faafa85-cf19-4f00-99fd-c0e38831bd11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:44.474255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faafa85-cf19-4f00-99fd-c0e38831bd11 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:44.544192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad89a2-9281-4a60-8930-099021abfaeb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:44.545155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad89a2-9281-4a60-8930-099021abfaeb service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:44.545511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad89a2-9281-4a60-8930-099021abfaeb service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:44.545889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad89a2-9281-4a60-8930-099021abfaeb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:44.548944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-95ad89a2-9281-4a60-8930-099021abfaeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:44.686828 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad89a2-9281-4a60-8930-099021abfaeb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:44.688348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ad89a2-9281-4a60-8930-099021abfaeb service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:44.722614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1201/2421] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:48.127533 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:48.129061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:48.271165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c397983e-60ad-4ef6-903c-334ad1871de5 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:48.276774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edcb1f-7ccc-4b7f-a849-d91b43644577 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:48.277472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edcb1f-7ccc-4b7f-a849-d91b43644577 service placement] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:48.277746 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edcb1f-7ccc-4b7f-a849-d91b43644577 service placement] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:48.278009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4edcb1f-7ccc-4b7f-a849-d91b43644577 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:48.279781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c4edcb1f-7ccc-4b7f-a849-d91b43644577 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:48.293439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edcb1f-7ccc-4b7f-a849-d91b43644577 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:48.295596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4edcb1f-7ccc-4b7f-a849-d91b43644577 service placement] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:48.312721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1221/2422] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:48.984503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad89a2-9281-4a60-8930-099021abfaeb service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:48.986505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-95ad89a2-9281-4a60-8930-099021abfaeb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:49.006902 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad89a2-9281-4a60-8930-099021abfaeb service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:49.012784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:49.013455 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.013727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.014064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] PATH_INFO: `/v3/users/dda19c20bfec49b8b9e1d589f7e3e188` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.015222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dda19c20bfec49b8b9e1d589f7e3e188)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:49.017671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:49.050469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:49.072662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dda19c20bfec49b8b9e1d589f7e3e188'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:49.073464 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dda19c20bfec49b8b9e1d589f7e3e188'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:49.074398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dda19c20bfec49b8b9e1d589f7e3e188'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:49.088624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dda19c20bfec49b8b9e1d589f7e3e188'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:49.098880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fc8d0075-924e-443b-a0cf-2475fecabe23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dda19c20bfec49b8b9e1d589f7e3e188'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:49.113489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1202/2423] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:48 2022] DELETE /identity/v3/users/dda19c20bfec49b8b9e1d589f7e3e188 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:49.303884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edcb1f-7ccc-4b7f-a849-d91b43644577 service placement] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:49.315137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4edcb1f-7ccc-4b7f-a849-d91b43644577 service placement] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:49.401233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:49.401910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.402188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.402486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] PATH_INFO: `/v3/projects/fcbd65e8543347109591297794b1056d` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.403642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fcbd65e8543347109591297794b1056d)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:49.405622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:49.460566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:49.462013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fcbd65e8543347109591297794b1056d', 'request_id': 'req-aaee0db9-975c-4252-9d69-3934c2f83ec1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:49.468323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fcbd65e8543347109591297794b1056d', 'request_id': 'req-aaee0db9-975c-4252-9d69-3934c2f83ec1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:49.477064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fcbd65e8543347109591297794b1056d', 'request_id': 'req-aaee0db9-975c-4252-9d69-3934c2f83ec1'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:49.488567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] The token cache is being invalidate because project fcbd65e8543347109591297794b1056d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:49.488879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:49.489597 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-aaee0db9-975c-4252-9d69-3934c2f83ec1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:49.491224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1222/2424] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:49 2022] DELETE /identity/v3/projects/fcbd65e8543347109591297794b1056d => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:49.496535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3cbfe-c7ed-43d5-bbd6-5137ff67ba77 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.496819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3cbfe-c7ed-43d5-bbd6-5137ff67ba77 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.497091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3cbfe-c7ed-43d5-bbd6-5137ff67ba77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.557627 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5da3cbfe-c7ed-43d5-bbd6-5137ff67ba77 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:49.558883 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5da3cbfe-c7ed-43d5-bbd6-5137ff67ba77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:49.632661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1203/2425] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:49.640673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa5e5-80b5-49ed-9381-56987f95ca94 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.640949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa5e5-80b5-49ed-9381-56987f95ca94 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.641554 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9fa5e5-80b5-49ed-9381-56987f95ca94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.662452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ae9fa5e5-80b5-49ed-9381-56987f95ca94 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:49.663698 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ae9fa5e5-80b5-49ed-9381-56987f95ca94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:49.675011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1223/2426] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:49.676757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3cbfe-c7ed-43d5-bbd6-5137ff67ba77 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:49.686459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3cbfe-c7ed-43d5-bbd6-5137ff67ba77 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:49.691450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e68666-4d75-49bf-b944-b57e924bdb5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:49.692063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e68666-4d75-49bf-b944-b57e924bdb5a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.692339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e68666-4d75-49bf-b944-b57e924bdb5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.692606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e68666-4d75-49bf-b944-b57e924bdb5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.693345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e68666-4d75-49bf-b944-b57e924bdb5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:49.693647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e68666-4d75-49bf-b944-b57e924bdb5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:49.695292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e68666-4d75-49bf-b944-b57e924bdb5a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:49.710804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1204/2427] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:13:49.713271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fa5e5-80b5-49ed-9381-56987f95ca94 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:49.723095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9fa5e5-80b5-49ed-9381-56987f95ca94 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:49.727978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b54122-7045-4f4d-9fe5-04471d589483 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:49.728610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b54122-7045-4f4d-9fe5-04471d589483 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.728859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b54122-7045-4f4d-9fe5-04471d589483 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.729112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b54122-7045-4f4d-9fe5-04471d589483 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.729768 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b54122-7045-4f4d-9fe5-04471d589483 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:49.731767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b54122-7045-4f4d-9fe5-04471d589483 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:49.748591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e68666-4d75-49bf-b944-b57e924bdb5a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:49.750633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d2e68666-4d75-49bf-b944-b57e924bdb5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:49.763558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1224/2428] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:49 2022] POST /identity/v3/projects => generated 391 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:49.768078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b54122-7045-4f4d-9fe5-04471d589483 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:49.820313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e68666-4d75-49bf-b944-b57e924bdb5a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:49.830801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b54122-7045-4f4d-9fe5-04471d589483 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:49.833743 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:49.836038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253f5a6-16c0-45bb-bb1b-368b758e1aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:49.836930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253f5a6-16c0-45bb-bb1b-368b758e1aae admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.837292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253f5a6-16c0-45bb-bb1b-368b758e1aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.837560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b253f5a6-16c0-45bb-bb1b-368b758e1aae admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.838231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253f5a6-16c0-45bb-bb1b-368b758e1aae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:49.840388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b253f5a6-16c0-45bb-bb1b-368b758e1aae admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:49.864383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1225/2429] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:49 2022] POST /identity/v3/users => generated 296 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:49.868497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253f5a6-16c0-45bb-bb1b-368b758e1aae admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:49.874131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce910b-1005-4f5f-811b-35f86ee4923e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:49.874747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce910b-1005-4f5f-811b-35f86ee4923e service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.875055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce910b-1005-4f5f-811b-35f86ee4923e service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.875327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ce910b-1005-4f5f-811b-35f86ee4923e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.877107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-11ce910b-1005-4f5f-811b-35f86ee4923e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:49.878346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b253f5a6-16c0-45bb-bb1b-368b758e1aae admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:49.882921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e56ec-6130-4d17-94e5-5f82d85fbdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:49.883454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e56ec-6130-4d17-94e5-5f82d85fbdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.883726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e56ec-6130-4d17-94e5-5f82d85fbdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.883989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e56ec-6130-4d17-94e5-5f82d85fbdd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.884618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e56ec-6130-4d17-94e5-5f82d85fbdd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:49.886202 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e56ec-6130-4d17-94e5-5f82d85fbdd0 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:49.889447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce910b-1005-4f5f-811b-35f86ee4923e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:49.890933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ce910b-1005-4f5f-811b-35f86ee4923e service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:49.897367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1226/2430] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:49.901422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e56ec-6130-4d17-94e5-5f82d85fbdd0 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:49.903004 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1205/2431] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:49.913606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e56ec-6130-4d17-94e5-5f82d85fbdd0 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:49.918484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abe8e1-15d0-42f7-988f-5e5f887dbb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:49.919203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abe8e1-15d0-42f7-988f-5e5f887dbb3a admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.922555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abe8e1-15d0-42f7-988f-5e5f887dbb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.922866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7abe8e1-15d0-42f7-988f-5e5f887dbb3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.923526 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abe8e1-15d0-42f7-988f-5e5f887dbb3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:49.925965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7abe8e1-15d0-42f7-988f-5e5f887dbb3a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:49.942563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1227/2432] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:49 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:49.946882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce910b-1005-4f5f-811b-35f86ee4923e service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:49.966227 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ce910b-1005-4f5f-811b-35f86ee4923e service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:49.970901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500491e4-f017-4322-834a-ebd91d236db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:49.971776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500491e4-f017-4322-834a-ebd91d236db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:49.971944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500491e4-f017-4322-834a-ebd91d236db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:49.972113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500491e4-f017-4322-834a-ebd91d236db0 admin admin] PATH_INFO: `/v3/projects/dc06cd3d533d42a3970e0a39f1e0934e/users/4b26558a222f42ae88159de222767873/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:49.988784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500491e4-f017-4322-834a-ebd91d236db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc06cd3d533d42a3970e0a39f1e0934e, user_id=4b26558a222f42ae88159de222767873, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:49.992572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500491e4-f017-4322-834a-ebd91d236db0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:50.002794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abe8e1-15d0-42f7-988f-5e5f887dbb3a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:50.004840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f7abe8e1-15d0-42f7-988f-5e5f887dbb3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:50.006070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1206/2433] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:49 2022] PUT /identity/v3/projects/dc06cd3d533d42a3970e0a39f1e0934e/users/4b26558a222f42ae88159de222767873/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:50.017871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc439734-d3d9-4130-9c05-586325ec9250 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.018130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7abe8e1-15d0-42f7-988f-5e5f887dbb3a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:50.018295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc439734-d3d9-4130-9c05-586325ec9250 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.018621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc439734-d3d9-4130-9c05-586325ec9250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:50.047979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-cc439734-d3d9-4130-9c05-586325ec9250 None None] MFA Rules not processed for user `4b26558a222f42ae88159de222767873`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:50.049660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cc439734-d3d9-4130-9c05-586325ec9250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:50.077543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a69d1-ab77-41ab-963e-32d7a017eafc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:50.078587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a69d1-ab77-41ab-963e-32d7a017eafc service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.078587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a69d1-ab77-41ab-963e-32d7a017eafc service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.078868 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a69d1-ab77-41ab-963e-32d7a017eafc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:50.080524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a54a69d1-ab77-41ab-963e-32d7a017eafc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:50.112356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:50.124937 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1207/2434] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:50.129685 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc439734-d3d9-4130-9c05-586325ec9250 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:50.155712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a69d1-ab77-41ab-963e-32d7a017eafc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:50.157302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a69d1-ab77-41ab-963e-32d7a017eafc service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:50.170146 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1228/2435] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:13:50.202833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc439734-d3d9-4130-9c05-586325ec9250 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:50.207793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f8e6c-8fcc-44c9-82ea-b6434bb5f537 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:50.208413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f8e6c-8fcc-44c9-82ea-b6434bb5f537 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.208871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f8e6c-8fcc-44c9-82ea-b6434bb5f537 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.209140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6f8e6c-8fcc-44c9-82ea-b6434bb5f537 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:50.209847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f8e6c-8fcc-44c9-82ea-b6434bb5f537 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:50.211849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6f8e6c-8fcc-44c9-82ea-b6434bb5f537 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:50.252359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1208/2436] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:50 2022] POST /identity/v3/projects => generated 393 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:50.254075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a69d1-ab77-41ab-963e-32d7a017eafc service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:50.265087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a69d1-ab77-41ab-963e-32d7a017eafc service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:50.330646 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0342e3-77f3-4d0a-aebb-70858f363da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:50.331396 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0342e3-77f3-4d0a-aebb-70858f363da1 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.331549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0342e3-77f3-4d0a-aebb-70858f363da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.331806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0342e3-77f3-4d0a-aebb-70858f363da1 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:50.332432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0342e3-77f3-4d0a-aebb-70858f363da1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:50.334395 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0342e3-77f3-4d0a-aebb-70858f363da1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:50.359098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1229/2437] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:50 2022] POST /identity/v3/users => generated 303 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:50.363483 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f8e6c-8fcc-44c9-82ea-b6434bb5f537 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:50.374161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6f8e6c-8fcc-44c9-82ea-b6434bb5f537 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:50.381058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727897bf-cc8d-4045-a149-1227d8fbbd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:50.381680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727897bf-cc8d-4045-a149-1227d8fbbd36 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.381959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727897bf-cc8d-4045-a149-1227d8fbbd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.382230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727897bf-cc8d-4045-a149-1227d8fbbd36 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:50.382928 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727897bf-cc8d-4045-a149-1227d8fbbd36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:50.384541 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727897bf-cc8d-4045-a149-1227d8fbbd36 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:50.391759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:50.398398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1209/2438] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:50.403396 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0342e3-77f3-4d0a-aebb-70858f363da1 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:50.414844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0342e3-77f3-4d0a-aebb-70858f363da1 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:50.419957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07f090-cba8-4fce-9b2e-23c2992f67ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:50.420649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07f090-cba8-4fce-9b2e-23c2992f67ac admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.420925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07f090-cba8-4fce-9b2e-23c2992f67ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.421193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf07f090-cba8-4fce-9b2e-23c2992f67ac admin admin] PATH_INFO: `/v3/projects/e943f98ee1d246578917f28ae00a6bf7/users/ec48328d94ca4ced98dbe0018fc40e4e/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:50.437844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07f090-cba8-4fce-9b2e-23c2992f67ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=e943f98ee1d246578917f28ae00a6bf7, user_id=ec48328d94ca4ced98dbe0018fc40e4e, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:50.440885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf07f090-cba8-4fce-9b2e-23c2992f67ac admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:50.456639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1230/2439] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:50 2022] PUT /identity/v3/projects/e943f98ee1d246578917f28ae00a6bf7/users/ec48328d94ca4ced98dbe0018fc40e4e/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:50.460660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727897bf-cc8d-4045-a149-1227d8fbbd36 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:50.471174 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727897bf-cc8d-4045-a149-1227d8fbbd36 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:50.545405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1150ee36-1a34-419d-8910-d764d0b32113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:50.546029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150ee36-1a34-419d-8910-d764d0b32113 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.546303 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150ee36-1a34-419d-8910-d764d0b32113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.546574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1150ee36-1a34-419d-8910-d764d0b32113 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:50.547257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150ee36-1a34-419d-8910-d764d0b32113 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:50.548889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1150ee36-1a34-419d-8910-d764d0b32113 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:50.560172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1210/2440] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:50 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:50.566804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07f090-cba8-4fce-9b2e-23c2992f67ac admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:50.585344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf07f090-cba8-4fce-9b2e-23c2992f67ac admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:50.594368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a12fb-12c2-41d0-af85-a4304fa1363d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:50.595629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a12fb-12c2-41d0-af85-a4304fa1363d admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.596127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a12fb-12c2-41d0-af85-a4304fa1363d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.596737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140a12fb-12c2-41d0-af85-a4304fa1363d admin admin] PATH_INFO: `/v3/projects/e943f98ee1d246578917f28ae00a6bf7/users/ec48328d94ca4ced98dbe0018fc40e4e/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:50.600083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a12fb-12c2-41d0-af85-a4304fa1363d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e943f98ee1d246578917f28ae00a6bf7, user_id=ec48328d94ca4ced98dbe0018fc40e4e, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:50.605318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140a12fb-12c2-41d0-af85-a4304fa1363d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:50.628913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1231/2441] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:50 2022] PUT /identity/v3/projects/e943f98ee1d246578917f28ae00a6bf7/users/ec48328d94ca4ced98dbe0018fc40e4e/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:50.646688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e1d3a-c46e-4a7b-bdde-3edff988f55b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.647171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e1d3a-c46e-4a7b-bdde-3edff988f55b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.647446 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e1d3a-c46e-4a7b-bdde-3edff988f55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:50.681420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6b7e1d3a-c46e-4a7b-bdde-3edff988f55b None None] MFA Rules not processed for user `ec48328d94ca4ced98dbe0018fc40e4e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:50.682542 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6b7e1d3a-c46e-4a7b-bdde-3edff988f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:50.776531 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1211/2442] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:50 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:50.789278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a12fb-12c2-41d0-af85-a4304fa1363d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:50.791574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-140a12fb-12c2-41d0-af85-a4304fa1363d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:50.858233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140a12fb-12c2-41d0-af85-a4304fa1363d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:50.863362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06754a15-3e13-4997-ada6-e9708c7717de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:50.864164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06754a15-3e13-4997-ada6-e9708c7717de service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.864444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06754a15-3e13-4997-ada6-e9708c7717de service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.864714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06754a15-3e13-4997-ada6-e9708c7717de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:50.875715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06754a15-3e13-4997-ada6-e9708c7717de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:50.877179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06754a15-3e13-4997-ada6-e9708c7717de service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:50.887390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1232/2443] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:50 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:13:50.940514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e1d3a-c46e-4a7b-bdde-3edff988f55b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:50.942062 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6b7e1d3a-c46e-4a7b-bdde-3edff988f55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:50.955339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e1d3a-c46e-4a7b-bdde-3edff988f55b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:50.959477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4957dba-69a8-42be-872a-9bcb89171750 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:50.960492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4957dba-69a8-42be-872a-9bcb89171750 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:50.960839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4957dba-69a8-42be-872a-9bcb89171750 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:50.961297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4957dba-69a8-42be-872a-9bcb89171750 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:51.024505 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4957dba-69a8-42be-872a-9bcb89171750 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:51.025992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4957dba-69a8-42be-872a-9bcb89171750 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:51.035767 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1212/2444] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:50 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:55.080422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06754a15-3e13-4997-ada6-e9708c7717de service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:55.108183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:55.120875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4957dba-69a8-42be-872a-9bcb89171750 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:55.122318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b4957dba-69a8-42be-872a-9bcb89171750 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:55.145677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:55.169452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06754a15-3e13-4997-ada6-e9708c7717de service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:55.176259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:55.177715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:55.178011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:55.178285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] PATH_INFO: `/v3/users/4b26558a222f42ae88159de222767873` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:55.179674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b26558a222f42ae88159de222767873)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:55.182728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:55.205246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4957dba-69a8-42be-872a-9bcb89171750 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:55.214851 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:55.215757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:55.216101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:55.216423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] PATH_INFO: `/v3/users/4774b2f6020b434595c578a738caccde` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:55.220060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=4774b2f6020b434595c578a738caccde)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:55.222751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:55.261907 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b26558a222f42ae88159de222767873'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.278548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b26558a222f42ae88159de222767873'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.294420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b26558a222f42ae88159de222767873'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.304781 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b26558a222f42ae88159de222767873'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.305498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b26558a222f42ae88159de222767873'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.308693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4774b2f6020b434595c578a738caccde'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.309699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4774b2f6020b434595c578a738caccde'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.310760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4774b2f6020b434595c578a738caccde'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.314389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1233/2445] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:55 2022] DELETE /identity/v3/users/4b26558a222f42ae88159de222767873 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:55.315298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:55.318065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:55.328095 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4774b2f6020b434595c578a738caccde'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.338269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-15adbc8d-490d-4127-a732-e336a4a295ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4774b2f6020b434595c578a738caccde'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.353889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1213/2446] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:55 2022] DELETE /identity/v3/users/4774b2f6020b434595c578a738caccde => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:55.355309 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcde23-965c-4809-981a-35b178285922 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:55.355738 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcde23-965c-4809-981a-35b178285922 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:55.356237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bcde23-965c-4809-981a-35b178285922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:55.385107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c6bcde23-965c-4809-981a-35b178285922 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:55.387347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c6bcde23-965c-4809-981a-35b178285922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:55.406847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eccec4-616d-4743-8941-5a95f9ecee4b admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:55.459562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:55.476380 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1214/2447] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:55.477311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:55.477973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:55.478248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:55.478568 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] PATH_INFO: `/v3/users/b44b18da73814fe78173631173a245c8` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:55.479852 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44b18da73814fe78173631173a245c8)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:55.481830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:55.490700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcde23-965c-4809-981a-35b178285922 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:55.492256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c6bcde23-965c-4809-981a-35b178285922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:55.542275 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44b18da73814fe78173631173a245c8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.546673 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:55.564705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44b18da73814fe78173631173a245c8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.575217 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44b18da73814fe78173631173a245c8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.585296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44b18da73814fe78173631173a245c8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.586236 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44b18da73814fe78173631173a245c8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.593054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1234/2448] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:55 2022] DELETE /identity/v3/users/b44b18da73814fe78173631173a245c8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:55.593700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:55.595124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:55.605773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bcde23-965c-4809-981a-35b178285922 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:55.660471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8010955-a7ce-4db5-9413-21710c94025c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:55.661220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8010955-a7ce-4db5-9413-21710c94025c service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:55.661479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8010955-a7ce-4db5-9413-21710c94025c service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:55.661863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8010955-a7ce-4db5-9413-21710c94025c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:55.664418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b8010955-a7ce-4db5-9413-21710c94025c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:55.676491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d9c66d-fd87-4b28-8ce0-613442fc9b34 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:55.677384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8010955-a7ce-4db5-9413-21710c94025c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:55.679623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8010955-a7ce-4db5-9413-21710c94025c service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:55.681399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:55.682076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:55.682354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:55.682627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] PATH_INFO: `/v3/projects/c8499e639cc142cf8e413460ca3d7adf` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:55.683801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8499e639cc142cf8e413460ca3d7adf)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:55.685754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:55.702601 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1215/2449] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:55.743159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8499e639cc142cf8e413460ca3d7adf', 'request_id': 'req-149df4b5-561d-4052-85de-a5347f63fec9'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.751508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8499e639cc142cf8e413460ca3d7adf', 'request_id': 'req-149df4b5-561d-4052-85de-a5347f63fec9'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.771317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8499e639cc142cf8e413460ca3d7adf', 'request_id': 'req-149df4b5-561d-4052-85de-a5347f63fec9'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.778249 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:55.792836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] The token cache is being invalidate because project c8499e639cc142cf8e413460ca3d7adf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:55.793860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.794702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-149df4b5-561d-4052-85de-a5347f63fec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.797232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1235/2450] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:55 2022] DELETE /identity/v3/projects/c8499e639cc142cf8e413460ca3d7adf => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:55.798502 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8010955-a7ce-4db5-9413-21710c94025c service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:55.800531 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b8010955-a7ce-4db5-9413-21710c94025c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:55.802188 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e8cbf-aa9e-48ad-91ee-8cfbe0a9e22a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:55.804437 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e8cbf-aa9e-48ad-91ee-8cfbe0a9e22a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:55.804808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461e8cbf-aa9e-48ad-91ee-8cfbe0a9e22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:55.830594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8010955-a7ce-4db5-9413-21710c94025c service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:55.847902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-461e8cbf-aa9e-48ad-91ee-8cfbe0a9e22a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:55.850621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-461e8cbf-aa9e-48ad-91ee-8cfbe0a9e22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:55.902325 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:55.903466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:55.903823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:55.904161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] PATH_INFO: `/v3/projects/1ebf02c9429a4018b1480e3077a967ac` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:55.906005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ebf02c9429a4018b1480e3077a967ac)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:55.908158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:55.923351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1236/2451] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:55.931616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883ebd-93c9-45c7-a73b-847b7cc40d8e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:55.931916 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883ebd-93c9-45c7-a73b-847b7cc40d8e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:55.932221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68883ebd-93c9-45c7-a73b-847b7cc40d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:55.953957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-68883ebd-93c9-45c7-a73b-847b7cc40d8e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:55.955717 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-68883ebd-93c9-45c7-a73b-847b7cc40d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:55.974322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ebf02c9429a4018b1480e3077a967ac', 'request_id': 'req-6cc670c1-d36b-4e48-a18e-df419f6c254a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.985712 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ebf02c9429a4018b1480e3077a967ac', 'request_id': 'req-6cc670c1-d36b-4e48-a18e-df419f6c254a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:55.997337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ebf02c9429a4018b1480e3077a967ac', 'request_id': 'req-6cc670c1-d36b-4e48-a18e-df419f6c254a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.013936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] The token cache is being invalidate because project 1ebf02c9429a4018b1480e3077a967ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:56.014192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.015028 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6cc670c1-d36b-4e48-a18e-df419f6c254a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.017237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1216/2452] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:55 2022] DELETE /identity/v3/projects/1ebf02c9429a4018b1480e3077a967ac => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:56.022828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1237/2453] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:56.023035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c9be-72cf-4520-893a-2edbb1c726f5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.023150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c9be-72cf-4520-893a-2edbb1c726f5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.023511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5c9be-72cf-4520-893a-2edbb1c726f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.025497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68883ebd-93c9-45c7-a73b-847b7cc40d8e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.035299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68883ebd-93c9-45c7-a73b-847b7cc40d8e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.040138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c43139-c4b4-44cb-b4fd-57a2ad442418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.040755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c43139-c4b4-44cb-b4fd-57a2ad442418 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.041034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c43139-c4b4-44cb-b4fd-57a2ad442418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.041313 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c43139-c4b4-44cb-b4fd-57a2ad442418 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.041976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c43139-c4b4-44cb-b4fd-57a2ad442418 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:56.042278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c43139-c4b4-44cb-b4fd-57a2ad442418 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.043955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c43139-c4b4-44cb-b4fd-57a2ad442418 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.049625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-82d5c9be-72cf-4520-893a-2edbb1c726f5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:56.050927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-82d5c9be-72cf-4520-893a-2edbb1c726f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.058944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1238/2454] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:13:56.062824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1217/2455] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:56.062985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c43139-c4b4-44cb-b4fd-57a2ad442418 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.062985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-00c43139-c4b4-44cb-b4fd-57a2ad442418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.063160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5c9be-72cf-4520-893a-2edbb1c726f5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.070142 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:56.074275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5c9be-72cf-4520-893a-2edbb1c726f5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.075436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c43139-c4b4-44cb-b4fd-57a2ad442418 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.080182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.080465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f6e178-9810-4297-8d75-6b853db0d85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.080926 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.081413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e178-9810-4297-8d75-6b853db0d85e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.081521 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.081616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e178-9810-4297-8d75-6b853db0d85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.081616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f6e178-9810-4297-8d75-6b853db0d85e admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.081796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] PATH_INFO: `/v3/projects/dc06cd3d533d42a3970e0a39f1e0934e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.082257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6e178-9810-4297-8d75-6b853db0d85e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.083016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc06cd3d533d42a3970e0a39f1e0934e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.084744 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f6e178-9810-4297-8d75-6b853db0d85e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.084929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.113874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1218/2456] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:56 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:56.115352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877a0db-5a2c-4e4d-a027-d0a17a0d6ca6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.115633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877a0db-5a2c-4e4d-a027-d0a17a0d6ca6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.115898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a877a0db-5a2c-4e4d-a027-d0a17a0d6ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.136145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a877a0db-5a2c-4e4d-a027-d0a17a0d6ca6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:56.137333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a877a0db-5a2c-4e4d-a027-d0a17a0d6ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.137907 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc06cd3d533d42a3970e0a39f1e0934e', 'request_id': 'req-64fe8955-7051-4705-9fef-70086ca5f231'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.146587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc06cd3d533d42a3970e0a39f1e0934e', 'request_id': 'req-64fe8955-7051-4705-9fef-70086ca5f231'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.155867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc06cd3d533d42a3970e0a39f1e0934e', 'request_id': 'req-64fe8955-7051-4705-9fef-70086ca5f231'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.171320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] The token cache is being invalidate because project dc06cd3d533d42a3970e0a39f1e0934e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:56.171608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.172266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.173783 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1239/2457] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:56 2022] DELETE /identity/v3/projects/dc06cd3d533d42a3970e0a39f1e0934e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:56.174794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.176155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.185413 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:56.204688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1219/2458] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:56.206236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877a0db-5a2c-4e4d-a027-d0a17a0d6ca6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.207620 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a877a0db-5a2c-4e4d-a027-d0a17a0d6ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.219530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a877a0db-5a2c-4e4d-a027-d0a17a0d6ca6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.224943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.225569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.225882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.226259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] PATH_INFO: `/v3/users/ec48328d94ca4ced98dbe0018fc40e4e` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.227403 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec48328d94ca4ced98dbe0018fc40e4e)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.229333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.245685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fe8955-7051-4705-9fef-70086ca5f231 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.250822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84180ce5-6a76-418e-af86-00469201c78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.251432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84180ce5-6a76-418e-af86-00469201c78d admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.251705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84180ce5-6a76-418e-af86-00469201c78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.251987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84180ce5-6a76-418e-af86-00469201c78d admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.252645 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84180ce5-6a76-418e-af86-00469201c78d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.255021 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84180ce5-6a76-418e-af86-00469201c78d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.277767 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec48328d94ca4ced98dbe0018fc40e4e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.277981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1240/2459] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:56 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:56.278794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84180ce5-6a76-418e-af86-00469201c78d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.279021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec48328d94ca4ced98dbe0018fc40e4e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.279623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec48328d94ca4ced98dbe0018fc40e4e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.289207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84180ce5-6a76-418e-af86-00469201c78d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.295308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c5277-1c98-4768-a4a4-756de0083740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.295571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec48328d94ca4ced98dbe0018fc40e4e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.295919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c5277-1c98-4768-a4a4-756de0083740 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.296195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c5277-1c98-4768-a4a4-756de0083740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.296461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c5277-1c98-4768-a4a4-756de0083740 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.297114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c5277-1c98-4768-a4a4-756de0083740 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:56.297417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c5277-1c98-4768-a4a4-756de0083740 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.299375 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c5277-1c98-4768-a4a4-756de0083740 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.304997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec48328d94ca4ced98dbe0018fc40e4e'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.313659 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1241/2460] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:13:56.314596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c5277-1c98-4768-a4a4-756de0083740 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.318256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-496c5277-1c98-4768-a4a4-756de0083740 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.321319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1220/2461] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:56 2022] DELETE /identity/v3/users/ec48328d94ca4ced98dbe0018fc40e4e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:56.322273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.323687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.332566 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c5277-1c98-4768-a4a4-756de0083740 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.397362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:56.405842 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf0ca0-fc3c-4cca-90c5-954f777386b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.406185 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf0ca0-fc3c-4cca-90c5-954f777386b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.406607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf0ca0-fc3c-4cca-90c5-954f777386b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.407209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cf0ca0-fc3c-4cca-90c5-954f777386b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.407583 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf0ca0-fc3c-4cca-90c5-954f777386b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.410047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cf0ca0-fc3c-4cca-90c5-954f777386b9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.411050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23143a10-c057-471e-9ebb-4b758a070ee6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.419299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3387e-252c-4125-a272-93fac369d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.420393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3387e-252c-4125-a272-93fac369d2ff admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.420393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3387e-252c-4125-a272-93fac369d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.420823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a3387e-252c-4125-a272-93fac369d2ff admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.421343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1242/2462] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:56.421632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3387e-252c-4125-a272-93fac369d2ff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.424356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a3387e-252c-4125-a272-93fac369d2ff admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.425919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf0ca0-fc3c-4cca-90c5-954f777386b9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.440319 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cf0ca0-fc3c-4cca-90c5-954f777386b9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.445452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff999b3a-cd14-42cb-b494-fed31cccce6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.446057 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff999b3a-cd14-42cb-b494-fed31cccce6e admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.446329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff999b3a-cd14-42cb-b494-fed31cccce6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.446625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff999b3a-cd14-42cb-b494-fed31cccce6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.447498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff999b3a-cd14-42cb-b494-fed31cccce6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.449122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff999b3a-cd14-42cb-b494-fed31cccce6e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.459125 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1221/2463] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:56 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:56.462604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1243/2464] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:56.465963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3387e-252c-4125-a272-93fac369d2ff admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.467272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff999b3a-cd14-42cb-b494-fed31cccce6e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.482598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff999b3a-cd14-42cb-b494-fed31cccce6e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.565692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f00973-c1c9-4e47-ba2a-085b206ea1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.566280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f00973-c1c9-4e47-ba2a-085b206ea1f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.566557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f00973-c1c9-4e47-ba2a-085b206ea1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.566854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f00973-c1c9-4e47-ba2a-085b206ea1f9 admin admin] PATH_INFO: `/v3/projects/8d728a1ecfac41f78fe6e606a3630b02/users/175503211b6e47f28bdf0873d983218e/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.575050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a3387e-252c-4125-a272-93fac369d2ff admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.579977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a1150-293f-41b6-8512-9c7e3e746214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.580718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a1150-293f-41b6-8512-9c7e3e746214 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.581109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a1150-293f-41b6-8512-9c7e3e746214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.581750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a1150-293f-41b6-8512-9c7e3e746214 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.582018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:56.582402 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a1150-293f-41b6-8512-9c7e3e746214 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.584694 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a1150-293f-41b6-8512-9c7e3e746214 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.585479 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f00973-c1c9-4e47-ba2a-085b206ea1f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d728a1ecfac41f78fe6e606a3630b02, user_id=175503211b6e47f28bdf0873d983218e, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.588775 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33f00973-c1c9-4e47-ba2a-085b206ea1f9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.610525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1244/2465] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:56 2022] PUT /identity/v3/projects/8d728a1ecfac41f78fe6e606a3630b02/users/175503211b6e47f28bdf0873d983218e/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:56.616146 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217752-c3bf-4faa-9906-1e205f0710e5 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.616889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217752-c3bf-4faa-9906-1e205f0710e5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.618838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1222/2466] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:56 2022] POST /identity/v3/users => generated 289 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:56.619170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7217752-c3bf-4faa-9906-1e205f0710e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.622793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a1150-293f-41b6-8512-9c7e3e746214 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.633737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a1150-293f-41b6-8512-9c7e3e746214 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.656262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-f7217752-c3bf-4faa-9906-1e205f0710e5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:56.658089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f7217752-c3bf-4faa-9906-1e205f0710e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.726829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5d54a-bfaf-458f-a80c-024573dd5223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.727462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5d54a-bfaf-458f-a80c-024573dd5223 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.727877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5d54a-bfaf-458f-a80c-024573dd5223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.728155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f5d54a-bfaf-458f-a80c-024573dd5223 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.729205 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5d54a-bfaf-458f-a80c-024573dd5223 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.730843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f5d54a-bfaf-458f-a80c-024573dd5223 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.742590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1245/2467] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:56.743637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217752-c3bf-4faa-9906-1e205f0710e5 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.744989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f7217752-c3bf-4faa-9906-1e205f0710e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.749265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1223/2468] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:56.750289 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5d54a-bfaf-458f-a80c-024573dd5223 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.762738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7217752-c3bf-4faa-9906-1e205f0710e5 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.766816 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f5d54a-bfaf-458f-a80c-024573dd5223 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.768917 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.769761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.770239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.770510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] PATH_INFO: `/v3/projects/e943f98ee1d246578917f28ae00a6bf7` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.771677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e943f98ee1d246578917f28ae00a6bf7)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.773637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.776212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02adf3a-38f6-4966-9c02-7fd91e2e7c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.776803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02adf3a-38f6-4966-9c02-7fd91e2e7c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.777077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02adf3a-38f6-4966-9c02-7fd91e2e7c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.777350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02adf3a-38f6-4966-9c02-7fd91e2e7c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.778017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02adf3a-38f6-4966-9c02-7fd91e2e7c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.779750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02adf3a-38f6-4966-9c02-7fd91e2e7c5a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.793975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1224/2469] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:56 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:56.793975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02adf3a-38f6-4966-9c02-7fd91e2e7c5a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.793975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b02adf3a-38f6-4966-9c02-7fd91e2e7c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.834877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e943f98ee1d246578917f28ae00a6bf7', 'request_id': 'req-4722267f-4947-4082-8303-f67b401ca113'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.841009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e943f98ee1d246578917f28ae00a6bf7', 'request_id': 'req-4722267f-4947-4082-8303-f67b401ca113'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.850086 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e943f98ee1d246578917f28ae00a6bf7', 'request_id': 'req-4722267f-4947-4082-8303-f67b401ca113'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.863190 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] The token cache is being invalidate because project e943f98ee1d246578917f28ae00a6bf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:56.863618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.866222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:56.867937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1246/2470] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:56 2022] DELETE /identity/v3/projects/e943f98ee1d246578917f28ae00a6bf7 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:56.868087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02adf3a-38f6-4966-9c02-7fd91e2e7c5a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.868859 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:56.870417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.873887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:56.922501 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6f8647-a337-4028-aae4-12bd3c6b7183 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.923258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f8647-a337-4028-aae4-12bd3c6b7183 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.923533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f8647-a337-4028-aae4-12bd3c6b7183 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.923827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6f8647-a337-4028-aae4-12bd3c6b7183 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.925728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3e6f8647-a337-4028-aae4-12bd3c6b7183 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:56.939032 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4722267f-4947-4082-8303-f67b401ca113 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:56.943716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca94289-10b1-4e18-804e-21261b082da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:56.944473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94289-10b1-4e18-804e-21261b082da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.944750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94289-10b1-4e18-804e-21261b082da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.945024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca94289-10b1-4e18-804e-21261b082da7 admin admin] PATH_INFO: `/v3/projects/5ddd67d3ed7c44d38c9214b2fae1d2e7/users/a8d6ce1791da443897225960a701d5bb/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.959976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca94289-10b1-4e18-804e-21261b082da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ddd67d3ed7c44d38c9214b2fae1d2e7, user_id=a8d6ce1791da443897225960a701d5bb, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.962974 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca94289-10b1-4e18-804e-21261b082da7 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:56.973103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:56.979898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1247/2471] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:56 2022] PUT /identity/v3/projects/5ddd67d3ed7c44d38c9214b2fae1d2e7/users/a8d6ce1791da443897225960a701d5bb/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:56.988625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9197039-178c-47df-a7a8-8735bc0d8c1a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:56.988625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9197039-178c-47df-a7a8-8735bc0d8c1a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:56.989703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9197039-178c-47df-a7a8-8735bc0d8c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:56.991790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f8647-a337-4028-aae4-12bd3c6b7183 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:56.993286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6f8647-a337-4028-aae4-12bd3c6b7183 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.006605 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1225/2472] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:57.007940 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7b91-809f-4763-9e0c-7441467bc626 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.008285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7b91-809f-4763-9e0c-7441467bc626 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.008560 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa7b91-809f-4763-9e0c-7441467bc626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.009599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d9197039-178c-47df-a7a8-8735bc0d8c1a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:57.010977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d9197039-178c-47df-a7a8-8735bc0d8c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:57.044469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-41fa7b91-809f-4763-9e0c-7441467bc626 None None] MFA Rules not processed for user `a8d6ce1791da443897225960a701d5bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:57.045729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-41fa7b91-809f-4763-9e0c-7441467bc626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:57.079438 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1248/2473] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:57.087675 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d71bc-b0d9-45cd-978e-c152e486db2e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.088330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d71bc-b0d9-45cd-978e-c152e486db2e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.088330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283d71bc-b0d9-45cd-978e-c152e486db2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.109411 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-283d71bc-b0d9-45cd-978e-c152e486db2e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:57.110752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-283d71bc-b0d9-45cd-978e-c152e486db2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:57.121618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1249/2474] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:57.125755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d71bc-b0d9-45cd-978e-c152e486db2e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.135644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283d71bc-b0d9-45cd-978e-c152e486db2e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.143681 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97304e6b-d0f2-4b0e-87df-82a81977ac4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.144293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97304e6b-d0f2-4b0e-87df-82a81977ac4f admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.144567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97304e6b-d0f2-4b0e-87df-82a81977ac4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.144888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97304e6b-d0f2-4b0e-87df-82a81977ac4f admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.145697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97304e6b-d0f2-4b0e-87df-82a81977ac4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:13:57.145995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97304e6b-d0f2-4b0e-87df-82a81977ac4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.147725 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97304e6b-d0f2-4b0e-87df-82a81977ac4f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.150473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1226/2475] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:57.155050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7b91-809f-4763-9e0c-7441467bc626 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.165091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1250/2476] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:13:57.170474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97304e6b-d0f2-4b0e-87df-82a81977ac4f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.173333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa7b91-809f-4763-9e0c-7441467bc626 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.180458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3682b5-5ba8-4dde-97b2-19b481e40fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.181084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3682b5-5ba8-4dde-97b2-19b481e40fdd admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.181348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3682b5-5ba8-4dde-97b2-19b481e40fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.181608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3682b5-5ba8-4dde-97b2-19b481e40fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.182241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3682b5-5ba8-4dde-97b2-19b481e40fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.182753 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97304e6b-d0f2-4b0e-87df-82a81977ac4f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.184206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3682b5-5ba8-4dde-97b2-19b481e40fdd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.188267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25fbe2-d957-4ce2-a1df-222bbcaf7de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.189080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25fbe2-d957-4ce2-a1df-222bbcaf7de8 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.189273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25fbe2-d957-4ce2-a1df-222bbcaf7de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.189517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25fbe2-d957-4ce2-a1df-222bbcaf7de8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.190387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25fbe2-d957-4ce2-a1df-222bbcaf7de8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.192505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25fbe2-d957-4ce2-a1df-222bbcaf7de8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.222294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1227/2477] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:57.226200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3682b5-5ba8-4dde-97b2-19b481e40fdd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.230383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1251/2478] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/projects => generated 387 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:57.231360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25fbe2-d957-4ce2-a1df-222bbcaf7de8 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.260841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:57.305262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25fbe2-d957-4ce2-a1df-222bbcaf7de8 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.305807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3682b5-5ba8-4dde-97b2-19b481e40fdd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.310201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9803dd3-cda9-4151-bccf-5396a0f7f5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.310672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd01716-a14e-41ea-b322-8ec7b9c11862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.311059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9803dd3-cda9-4151-bccf-5396a0f7f5c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.311298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01716-a14e-41ea-b322-8ec7b9c11862 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.311556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9803dd3-cda9-4151-bccf-5396a0f7f5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.311726 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01716-a14e-41ea-b322-8ec7b9c11862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.311843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9803dd3-cda9-4151-bccf-5396a0f7f5c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.311932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd01716-a14e-41ea-b322-8ec7b9c11862 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.312524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd01716-a14e-41ea-b322-8ec7b9c11862 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.312639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9803dd3-cda9-4151-bccf-5396a0f7f5c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.314685 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd01716-a14e-41ea-b322-8ec7b9c11862 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.315284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9803dd3-cda9-4151-bccf-5396a0f7f5c3 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.342801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1252/2479] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:57.344592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1228/2480] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/users => generated 294 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:13:57.349079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9803dd3-cda9-4151-bccf-5396a0f7f5c3 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.351084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd01716-a14e-41ea-b322-8ec7b9c11862 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.362846 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9803dd3-cda9-4151-bccf-5396a0f7f5c3 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.363112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd01716-a14e-41ea-b322-8ec7b9c11862 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.368090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90334-7434-4a82-871a-64ecbbe34d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.368502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb0c4-4d71-4bce-8e12-63b6e94e57df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.368700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90334-7434-4a82-871a-64ecbbe34d43 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.368972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90334-7434-4a82-871a-64ecbbe34d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.369140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb0c4-4d71-4bce-8e12-63b6e94e57df admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.369255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e90334-7434-4a82-871a-64ecbbe34d43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.369875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb0c4-4d71-4bce-8e12-63b6e94e57df admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.369875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615eb0c4-4d71-4bce-8e12-63b6e94e57df admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.370078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90334-7434-4a82-871a-64ecbbe34d43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.370286 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eb0c4-4d71-4bce-8e12-63b6e94e57df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.371988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615eb0c4-4d71-4bce-8e12-63b6e94e57df admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.372104 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e90334-7434-4a82-871a-64ecbbe34d43 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.389523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1229/2481] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:57.389839 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1253/2482] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:57.389981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90334-7434-4a82-871a-64ecbbe34d43 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.390650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb0c4-4d71-4bce-8e12-63b6e94e57df admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.400930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e90334-7434-4a82-871a-64ecbbe34d43 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.406210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d301755-6ed9-4d63-949b-9cc14ce83670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.406912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d301755-6ed9-4d63-949b-9cc14ce83670 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.407258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d301755-6ed9-4d63-949b-9cc14ce83670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.407596 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d301755-6ed9-4d63-949b-9cc14ce83670 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.408312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d301755-6ed9-4d63-949b-9cc14ce83670 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.410235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d301755-6ed9-4d63-949b-9cc14ce83670 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.411143 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615eb0c4-4d71-4bce-8e12-63b6e94e57df admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.420299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe569a5-c5d3-4729-9956-991955cd2cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.421315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe569a5-c5d3-4729-9956-991955cd2cca admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.421979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe569a5-c5d3-4729-9956-991955cd2cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.422458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe569a5-c5d3-4729-9956-991955cd2cca admin admin] PATH_INFO: `/v3/projects/6de57cde7cc04a91b4d45e991a288b0d/users/67c1b983fdf94228997fb915e7088e41/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.426289 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1230/2483] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:57.427433 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d301755-6ed9-4d63-949b-9cc14ce83670 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.439740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d301755-6ed9-4d63-949b-9cc14ce83670 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.445652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b85160-7edf-434a-b7f7-a9facb07dc10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.446471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b85160-7edf-434a-b7f7-a9facb07dc10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.447166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b85160-7edf-434a-b7f7-a9facb07dc10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.447166 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b85160-7edf-434a-b7f7-a9facb07dc10 admin admin] PATH_INFO: `/v3/projects/a184401ca3174aecb1c1dd92e6954c28/users/8cf621b360e54b3388f39ae6f2bdfd3a/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.450376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe569a5-c5d3-4729-9956-991955cd2cca admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de57cde7cc04a91b4d45e991a288b0d, user_id=67c1b983fdf94228997fb915e7088e41, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.458459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe569a5-c5d3-4729-9956-991955cd2cca admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.466525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b85160-7edf-434a-b7f7-a9facb07dc10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a184401ca3174aecb1c1dd92e6954c28, user_id=8cf621b360e54b3388f39ae6f2bdfd3a, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.469517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b85160-7edf-434a-b7f7-a9facb07dc10 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.476311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1254/2484] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:57 2022] PUT /identity/v3/projects/6de57cde7cc04a91b4d45e991a288b0d/users/67c1b983fdf94228997fb915e7088e41/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:57.480960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe569a5-c5d3-4729-9956-991955cd2cca admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.487971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1231/2485] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:57 2022] PUT /identity/v3/projects/a184401ca3174aecb1c1dd92e6954c28/users/8cf621b360e54b3388f39ae6f2bdfd3a/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:57.499986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:57.501210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8c582-9d51-456a-8c0f-8c58715a13cc None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.501619 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8c582-9d51-456a-8c0f-8c58715a13cc None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.502039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f8c582-9d51-456a-8c0f-8c58715a13cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.533958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-00f8c582-9d51-456a-8c0f-8c58715a13cc None None] MFA Rules not processed for user `8cf621b360e54b3388f39ae6f2bdfd3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:57.535617 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-00f8c582-9d51-456a-8c0f-8c58715a13cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:57.561543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe569a5-c5d3-4729-9956-991955cd2cca admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.608274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1232/2486] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:57.613623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8c582-9d51-456a-8c0f-8c58715a13cc None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.637686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f7c7f-77ce-47e8-98ed-4d5f43adc9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.638345 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f7c7f-77ce-47e8-98ed-4d5f43adc9dd admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.638621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f7c7f-77ce-47e8-98ed-4d5f43adc9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.638922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813f7c7f-77ce-47e8-98ed-4d5f43adc9dd admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.639822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f7c7f-77ce-47e8-98ed-4d5f43adc9dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.642435 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813f7c7f-77ce-47e8-98ed-4d5f43adc9dd admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.655801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1255/2487] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:57 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:57.659636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f7c7f-77ce-47e8-98ed-4d5f43adc9dd admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.672264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813f7c7f-77ce-47e8-98ed-4d5f43adc9dd admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.678271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b51c84-09df-4aee-8813-de85c24b77c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.678850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51c84-09df-4aee-8813-de85c24b77c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.679126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51c84-09df-4aee-8813-de85c24b77c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.679390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b51c84-09df-4aee-8813-de85c24b77c1 admin admin] PATH_INFO: `/v3/projects/6de57cde7cc04a91b4d45e991a288b0d/users/67c1b983fdf94228997fb915e7088e41/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.681355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b51c84-09df-4aee-8813-de85c24b77c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6de57cde7cc04a91b4d45e991a288b0d, user_id=67c1b983fdf94228997fb915e7088e41, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.684227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b51c84-09df-4aee-8813-de85c24b77c1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.685471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f8c582-9d51-456a-8c0f-8c58715a13cc None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.691184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7686eb9-d460-4e23-9aa0-0d933528c21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.691864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7686eb9-d460-4e23-9aa0-0d933528c21d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.692228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7686eb9-d460-4e23-9aa0-0d933528c21d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.692497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7686eb9-d460-4e23-9aa0-0d933528c21d admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.693186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7686eb9-d460-4e23-9aa0-0d933528c21d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.695144 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7686eb9-d460-4e23-9aa0-0d933528c21d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.705715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1256/2488] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:57 2022] PUT /identity/v3/projects/6de57cde7cc04a91b4d45e991a288b0d/users/67c1b983fdf94228997fb915e7088e41/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:57.705918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:57.707909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d00bd-d9d8-4854-a5b1-188dd77155f5 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.708118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d00bd-d9d8-4854-a5b1-188dd77155f5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.708394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720d00bd-d9d8-4854-a5b1-188dd77155f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.739963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-720d00bd-d9d8-4854-a5b1-188dd77155f5 None None] MFA Rules not processed for user `67c1b983fdf94228997fb915e7088e41`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:57.741513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-720d00bd-d9d8-4854-a5b1-188dd77155f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:57.755347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1233/2489] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/projects => generated 389 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:57.756798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0257-affb-4dee-904c-03752c4d19ea None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.757508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0257-affb-4dee-904c-03752c4d19ea None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.757787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9f0257-affb-4dee-904c-03752c4d19ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.792525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3f9f0257-affb-4dee-904c-03752c4d19ea None None] MFA Rules not processed for user `175503211b6e47f28bdf0873d983218e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:57.793850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3f9f0257-affb-4dee-904c-03752c4d19ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:57.826739 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1257/2490] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:57.828092 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d00bd-d9d8-4854-a5b1-188dd77155f5 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.863391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:57.872853 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1234/2491] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:57.873841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0257-affb-4dee-904c-03752c4d19ea None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:57.875480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3f9f0257-affb-4dee-904c-03752c4d19ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:57.911360 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720d00bd-d9d8-4854-a5b1-188dd77155f5 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.945167 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9f0257-affb-4dee-904c-03752c4d19ea None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:57.949917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38152ba-ac67-4a7d-8329-b7609f995b42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.950527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38152ba-ac67-4a7d-8329-b7609f995b42 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.950825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38152ba-ac67-4a7d-8329-b7609f995b42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.951093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38152ba-ac67-4a7d-8329-b7609f995b42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.971399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13203c-1286-400c-af51-36f146db626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:57.972049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13203c-1286-400c-af51-36f146db626c admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:57.972327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13203c-1286-400c-af51-36f146db626c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:57.972603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13203c-1286-400c-af51-36f146db626c admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:57.973230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13203c-1286-400c-af51-36f146db626c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:57.975203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13203c-1286-400c-af51-36f146db626c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:57.997600 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1258/2492] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/users => generated 301 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:57.998530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13203c-1286-400c-af51-36f146db626c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.000913 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ca13203c-1286-400c-af51-36f146db626c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:58.010957 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38152ba-ac67-4a7d-8329-b7609f995b42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.012255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13203c-1286-400c-af51-36f146db626c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.012453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38152ba-ac67-4a7d-8329-b7609f995b42 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.017139 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2105f4-4a7e-44a0-a2bd-b2c9127dc07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.017784 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2105f4-4a7e-44a0-a2bd-b2c9127dc07e admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.018229 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2105f4-4a7e-44a0-a2bd-b2c9127dc07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.018508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2105f4-4a7e-44a0-a2bd-b2c9127dc07e admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.019203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2105f4-4a7e-44a0-a2bd-b2c9127dc07e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.021081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2105f4-4a7e-44a0-a2bd-b2c9127dc07e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.022310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1235/2493] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:58.023168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38152ba-ac67-4a7d-8329-b7609f995b42 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.033961 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38152ba-ac67-4a7d-8329-b7609f995b42 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.039802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804bb67-e546-49d6-9cac-ddd2dda9e7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.040702 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804bb67-e546-49d6-9cac-ddd2dda9e7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.041049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804bb67-e546-49d6-9cac-ddd2dda9e7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.041422 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7804bb67-e546-49d6-9cac-ddd2dda9e7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.042250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804bb67-e546-49d6-9cac-ddd2dda9e7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.043919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7804bb67-e546-49d6-9cac-ddd2dda9e7a0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.053755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1259/2494] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:13:57 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:58.056020 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1236/2495] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:58.057806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2105f4-4a7e-44a0-a2bd-b2c9127dc07e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.059889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804bb67-e546-49d6-9cac-ddd2dda9e7a0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.073799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7804bb67-e546-49d6-9cac-ddd2dda9e7a0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.088224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:58.129046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2105f4-4a7e-44a0-a2bd-b2c9127dc07e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.133967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1375c-ab97-4057-b753-f82f0f1eca04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.134688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1375c-ab97-4057-b753-f82f0f1eca04 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.135017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1375c-ab97-4057-b753-f82f0f1eca04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.135348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1375c-ab97-4057-b753-f82f0f1eca04 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.136070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1375c-ab97-4057-b753-f82f0f1eca04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.138043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e1375c-ab97-4057-b753-f82f0f1eca04 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.144633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf24128-1588-45c7-82d2-9368e061a8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.145296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf24128-1588-45c7-82d2-9368e061a8e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.145573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf24128-1588-45c7-82d2-9368e061a8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.145846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf24128-1588-45c7-82d2-9368e061a8e7 admin admin] PATH_INFO: `/v3/projects/a39733abc6b14309ba014893e251a05d/users/7bcd8dac892f4204ac9c9772f8cd174a/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.163028 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1260/2496] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:13:58 2022] POST /identity/v3/users => generated 309 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:13:58.164196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf24128-1588-45c7-82d2-9368e061a8e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39733abc6b14309ba014893e251a05d, user_id=7bcd8dac892f4204ac9c9772f8cd174a, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.167128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1375c-ab97-4057-b753-f82f0f1eca04 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.168474 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf24128-1588-45c7-82d2-9368e061a8e7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.177641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e1375c-ab97-4057-b753-f82f0f1eca04 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.184941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1237/2497] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:58 2022] PUT /identity/v3/projects/a39733abc6b14309ba014893e251a05d/users/7bcd8dac892f4204ac9c9772f8cd174a/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:58.188877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf24128-1588-45c7-82d2-9368e061a8e7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.214090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:58.247209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613c300-ca23-4000-8537-e1a73892ff69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.247966 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613c300-ca23-4000-8537-e1a73892ff69 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.248342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613c300-ca23-4000-8537-e1a73892ff69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.248714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613c300-ca23-4000-8537-e1a73892ff69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.249515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613c300-ca23-4000-8537-e1a73892ff69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.251368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613c300-ca23-4000-8537-e1a73892ff69 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.260026 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf24128-1588-45c7-82d2-9368e061a8e7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.263199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1261/2498] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:58.267794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613c300-ca23-4000-8537-e1a73892ff69 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.269798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a04c6-fc7b-4b9f-ba8a-86cb59cb8aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.270334 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a04c6-fc7b-4b9f-ba8a-86cb59cb8aae admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.270611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a04c6-fc7b-4b9f-ba8a-86cb59cb8aae admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.270909 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8a04c6-fc7b-4b9f-ba8a-86cb59cb8aae admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.271587 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a04c6-fc7b-4b9f-ba8a-86cb59cb8aae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.273157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8a04c6-fc7b-4b9f-ba8a-86cb59cb8aae admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.278658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613c300-ca23-4000-8537-e1a73892ff69 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.284439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4506161-6d71-4c90-b21f-b9dada967d05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.285099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4506161-6d71-4c90-b21f-b9dada967d05 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.285374 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4506161-6d71-4c90-b21f-b9dada967d05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.285637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4506161-6d71-4c90-b21f-b9dada967d05 admin admin] PATH_INFO: `/v3/projects/95ba9cf02d7a438eb83c1875f4f54b31/users/39237e374a2a4cba95f7febe3c9c60a3/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.286960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1238/2499] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:13:58.296582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a04c6-fc7b-4b9f-ba8a-86cb59cb8aae admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.303165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4506161-6d71-4c90-b21f-b9dada967d05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ba9cf02d7a438eb83c1875f4f54b31, user_id=39237e374a2a4cba95f7febe3c9c60a3, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.306163 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4506161-6d71-4c90-b21f-b9dada967d05 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.308941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8a04c6-fc7b-4b9f-ba8a-86cb59cb8aae admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.315133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f163782-d3be-4355-b3e8-ec3470953a4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.316387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f163782-d3be-4355-b3e8-ec3470953a4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.316671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f163782-d3be-4355-b3e8-ec3470953a4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.317070 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f163782-d3be-4355-b3e8-ec3470953a4a admin admin] PATH_INFO: `/v3/projects/a39733abc6b14309ba014893e251a05d/users/7bcd8dac892f4204ac9c9772f8cd174a/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.319277 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f163782-d3be-4355-b3e8-ec3470953a4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a39733abc6b14309ba014893e251a05d, user_id=7bcd8dac892f4204ac9c9772f8cd174a, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.322368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f163782-d3be-4355-b3e8-ec3470953a4a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.326164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1262/2500] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:58 2022] PUT /identity/v3/projects/95ba9cf02d7a438eb83c1875f4f54b31/users/39237e374a2a4cba95f7febe3c9c60a3/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:58.330194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4506161-6d71-4c90-b21f-b9dada967d05 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.342317 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1239/2501] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:58 2022] PUT /identity/v3/projects/a39733abc6b14309ba014893e251a05d/users/7bcd8dac892f4204ac9c9772f8cd174a/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:58.353008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743249b-568c-4ad5-839d-0263f25cab63 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.353305 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743249b-568c-4ad5-839d-0263f25cab63 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.353577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f743249b-568c-4ad5-839d-0263f25cab63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.394794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-f743249b-568c-4ad5-839d-0263f25cab63 None None] MFA Rules not processed for user `7bcd8dac892f4204ac9c9772f8cd174a`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:58.396169 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f743249b-568c-4ad5-839d-0263f25cab63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:58.421414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4506161-6d71-4c90-b21f-b9dada967d05 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.475636 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1240/2502] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:58 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:13:58.483001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28580112-5ff8-4d2b-bc61-ae5001d5ea87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.483700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28580112-5ff8-4d2b-bc61-ae5001d5ea87 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.484048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28580112-5ff8-4d2b-bc61-ae5001d5ea87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.484318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28580112-5ff8-4d2b-bc61-ae5001d5ea87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.484970 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28580112-5ff8-4d2b-bc61-ae5001d5ea87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.486682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28580112-5ff8-4d2b-bc61-ae5001d5ea87 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.487092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743249b-568c-4ad5-839d-0263f25cab63 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.501408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:58.506887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1263/2503] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:13:58 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:13:58.508031 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28580112-5ff8-4d2b-bc61-ae5001d5ea87 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.518693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28580112-5ff8-4d2b-bc61-ae5001d5ea87 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.524253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b832e7-127b-4d53-bcc0-b6432bb0e647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.524911 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b832e7-127b-4d53-bcc0-b6432bb0e647 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.525183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b832e7-127b-4d53-bcc0-b6432bb0e647 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.525449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b832e7-127b-4d53-bcc0-b6432bb0e647 admin admin] PATH_INFO: `/v3/projects/95ba9cf02d7a438eb83c1875f4f54b31/users/39237e374a2a4cba95f7febe3c9c60a3/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.527344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b832e7-127b-4d53-bcc0-b6432bb0e647 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95ba9cf02d7a438eb83c1875f4f54b31, user_id=39237e374a2a4cba95f7febe3c9c60a3, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.530152 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b832e7-127b-4d53-bcc0-b6432bb0e647 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.540705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1264/2504] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:13:58 2022] PUT /identity/v3/projects/95ba9cf02d7a438eb83c1875f4f54b31/users/39237e374a2a4cba95f7febe3c9c60a3/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:13:58.550102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f743249b-568c-4ad5-839d-0263f25cab63 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.599102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248fdfc1-63db-45bc-89cd-c2a515f3db19 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.599717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fdfc1-63db-45bc-89cd-c2a515f3db19 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.599974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fdfc1-63db-45bc-89cd-c2a515f3db19 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.600246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248fdfc1-63db-45bc-89cd-c2a515f3db19 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.671401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fdfc1-63db-45bc-89cd-c2a515f3db19 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.672921 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248fdfc1-63db-45bc-89cd-c2a515f3db19 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.684517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1241/2505] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:58 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:13:58.826028 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b832e7-127b-4d53-bcc0-b6432bb0e647 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:58.864488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:58.902958 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b832e7-127b-4d53-bcc0-b6432bb0e647 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:58.907711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:58.908616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:58.908892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:58.909163 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] PATH_INFO: `/v3/users/8cf621b360e54b3388f39ae6f2bdfd3a` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:58.910515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cf621b360e54b3388f39ae6f2bdfd3a)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:58.912703 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:58.969473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cf621b360e54b3388f39ae6f2bdfd3a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:58.983444 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cf621b360e54b3388f39ae6f2bdfd3a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:58.992602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cf621b360e54b3388f39ae6f2bdfd3a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.000732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cf621b360e54b3388f39ae6f2bdfd3a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.001417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cf621b360e54b3388f39ae6f2bdfd3a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.007439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1265/2506] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:58 2022] DELETE /identity/v3/users/8cf621b360e54b3388f39ae6f2bdfd3a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:59.012050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792f2fd-b7e5-4549-8141-7bfd69b1a9ca None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:59.012327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792f2fd-b7e5-4549-8141-7bfd69b1a9ca None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:59.012751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3792f2fd-b7e5-4549-8141-7bfd69b1a9ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:59.032164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3792f2fd-b7e5-4549-8141-7bfd69b1a9ca None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:59.033365 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3792f2fd-b7e5-4549-8141-7bfd69b1a9ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:59.101598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1242/2507] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:59.112137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:59.114009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:59.181316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcfae1f-61cd-4e28-ade1-9d78e8e3d629 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:59.187077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa59c1d-d045-4d33-bddd-a5df9e5b6461 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:59.187709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59c1d-d045-4d33-bddd-a5df9e5b6461 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:59.188205 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59c1d-d045-4d33-bddd-a5df9e5b6461 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:59.188484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa59c1d-d045-4d33-bddd-a5df9e5b6461 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:59.200427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa59c1d-d045-4d33-bddd-a5df9e5b6461 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:59.202266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa59c1d-d045-4d33-bddd-a5df9e5b6461 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:59.214732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1266/2508] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:13:59.218150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d3e8e-dcf7-4669-937b-db2cbe399ad0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:59.219151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d3e8e-dcf7-4669-937b-db2cbe399ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:59.219633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7d3e8e-dcf7-4669-937b-db2cbe399ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:59.251808 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2e7d3e8e-dcf7-4669-937b-db2cbe399ad0 None None] MFA Rules not processed for user `39237e374a2a4cba95f7febe3c9c60a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:13:59.253569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2e7d3e8e-dcf7-4669-937b-db2cbe399ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:59.258332 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:59.348761 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1243/2509] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:13:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:13:59.559849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa59c1d-d045-4d33-bddd-a5df9e5b6461 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:59.561796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4fa59c1d-d045-4d33-bddd-a5df9e5b6461 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:13:59.584301 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa59c1d-d045-4d33-bddd-a5df9e5b6461 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:59.591409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:59.592283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:59.597535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:59.598102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] PATH_INFO: `/v3/projects/a184401ca3174aecb1c1dd92e6954c28` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:59.600518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=a184401ca3174aecb1c1dd92e6954c28)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:59.602889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:59.683702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a184401ca3174aecb1c1dd92e6954c28', 'request_id': 'req-fb32c861-b7d9-475b-badf-30384d7629ab'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.688538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:13:59.696458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a184401ca3174aecb1c1dd92e6954c28', 'request_id': 'req-fb32c861-b7d9-475b-badf-30384d7629ab'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.710851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a184401ca3174aecb1c1dd92e6954c28', 'request_id': 'req-fb32c861-b7d9-475b-badf-30384d7629ab'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.730422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] The token cache is being invalidate because project a184401ca3174aecb1c1dd92e6954c28 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:13:59.730932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.731682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.733440 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1267/2510] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:13:59 2022] DELETE /identity/v3/projects/a184401ca3174aecb1c1dd92e6954c28 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:13:59.739624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d3e8e-dcf7-4669-937b-db2cbe399ad0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:13:59.750030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7d3e8e-dcf7-4669-937b-db2cbe399ad0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:13:59.816720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:13:59.817407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:13:59.817660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:13:59.818395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] PATH_INFO: `/v3/users/7bcd8dac892f4204ac9c9772f8cd174a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:13:59.819256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bcd8dac892f4204ac9c9772f8cd174a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:13:59.821412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:13:59.879224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bcd8dac892f4204ac9c9772f8cd174a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.879959 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bcd8dac892f4204ac9c9772f8cd174a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.880684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bcd8dac892f4204ac9c9772f8cd174a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.896231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bcd8dac892f4204ac9c9772f8cd174a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.906462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5e1cd631-0a15-4202-801e-baa56cf1590e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bcd8dac892f4204ac9c9772f8cd174a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:13:59.920891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1244/2511] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:13:59 2022] DELETE /identity/v3/users/7bcd8dac892f4204ac9c9772f8cd174a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:00.375400 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:00.376891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:00.392222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb32c861-b7d9-475b-badf-30384d7629ab admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:00.461334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:00.461989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:00.462267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:00.462540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] PATH_INFO: `/v3/projects/a39733abc6b14309ba014893e251a05d` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:00.463695 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a39733abc6b14309ba014893e251a05d)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:00.465605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:00.517170 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a39733abc6b14309ba014893e251a05d', 'request_id': 'req-5d0814e6-4f84-45cf-ac7c-60d837727f94'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:00.524135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a39733abc6b14309ba014893e251a05d', 'request_id': 'req-5d0814e6-4f84-45cf-ac7c-60d837727f94'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:00.536289 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a39733abc6b14309ba014893e251a05d', 'request_id': 'req-5d0814e6-4f84-45cf-ac7c-60d837727f94'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:00.549723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] The token cache is being invalidate because project a39733abc6b14309ba014893e251a05d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:00.550140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:00.550732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5d0814e6-4f84-45cf-ac7c-60d837727f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:00.552256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1268/2512] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:00 2022] DELETE /identity/v3/projects/a39733abc6b14309ba014893e251a05d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:00.557341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee410-a7ee-4472-97f2-8dc12174d655 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:00.557893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee410-a7ee-4472-97f2-8dc12174d655 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:00.557893 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547ee410-a7ee-4472-97f2-8dc12174d655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:00.582350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-547ee410-a7ee-4472-97f2-8dc12174d655 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:00.583781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-547ee410-a7ee-4472-97f2-8dc12174d655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:00.599352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:00.656590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1245/2513] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:00.665174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f3d2e-adc0-444a-b855-948c83a8ed4c None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:00.665469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f3d2e-adc0-444a-b855-948c83a8ed4c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:00.665717 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3f3d2e-adc0-444a-b855-948c83a8ed4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:00.687818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-cf3f3d2e-adc0-444a-b855-948c83a8ed4c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:00.689047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-cf3f3d2e-adc0-444a-b855-948c83a8ed4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:00.698641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1269/2514] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:00.702997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee410-a7ee-4472-97f2-8dc12174d655 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:00.713634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547ee410-a7ee-4472-97f2-8dc12174d655 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:00.718581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a883d05-f039-4989-8632-99273eefcdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:00.719235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a883d05-f039-4989-8632-99273eefcdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:00.719518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a883d05-f039-4989-8632-99273eefcdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:00.719787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a883d05-f039-4989-8632-99273eefcdb8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:00.720673 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a883d05-f039-4989-8632-99273eefcdb8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:00.721024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a883d05-f039-4989-8632-99273eefcdb8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:00.722932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a883d05-f039-4989-8632-99273eefcdb8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:00.737300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1246/2515] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:14:00.748772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f3d2e-adc0-444a-b855-948c83a8ed4c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:00.762383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3f3d2e-adc0-444a-b855-948c83a8ed4c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:00.767955 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe2727-3d13-4a77-8c4c-e2f1b28ca212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:00.768508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe2727-3d13-4a77-8c4c-e2f1b28ca212 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:00.769030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe2727-3d13-4a77-8c4c-e2f1b28ca212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:00.769030 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe2727-3d13-4a77-8c4c-e2f1b28ca212 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:00.769591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe2727-3d13-4a77-8c4c-e2f1b28ca212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:00.773504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe2727-3d13-4a77-8c4c-e2f1b28ca212 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:00.800884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1270/2516] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:00 2022] POST /identity/v3/projects => generated 407 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:00.805099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a883d05-f039-4989-8632-99273eefcdb8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:00.815653 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a883d05-f039-4989-8632-99273eefcdb8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:00.864605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe2727-3d13-4a77-8c4c-e2f1b28ca212 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:00.866702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a0fe2727-3d13-4a77-8c4c-e2f1b28ca212 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:00.881999 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec3eb0-2d74-4c8f-9726-8b67e1b14d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:00.882663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec3eb0-2d74-4c8f-9726-8b67e1b14d04 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:00.882970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec3eb0-2d74-4c8f-9726-8b67e1b14d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:00.883238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec3eb0-2d74-4c8f-9726-8b67e1b14d04 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:00.883901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec3eb0-2d74-4c8f-9726-8b67e1b14d04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:00.885926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec3eb0-2d74-4c8f-9726-8b67e1b14d04 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:00.910466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1247/2517] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:00 2022] POST /identity/v3/users => generated 304 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:00.913508 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:DELETE=10,keystone:SELECT=87,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:00.914525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec3eb0-2d74-4c8f-9726-8b67e1b14d04 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:00.926236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec3eb0-2d74-4c8f-9726-8b67e1b14d04 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:00.930969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cad974-3c1d-47bc-9680-cab97192d5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:00.931571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad974-3c1d-47bc-9680-cab97192d5b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:00.931850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad974-3c1d-47bc-9680-cab97192d5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:00.932124 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cad974-3c1d-47bc-9680-cab97192d5b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:00.932783 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cad974-3c1d-47bc-9680-cab97192d5b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:00.934408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cad974-3c1d-47bc-9680-cab97192d5b4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:00.937784 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe2727-3d13-4a77-8c4c-e2f1b28ca212 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:00.943121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:00.943825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:00.944178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:00.944510 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] PATH_INFO: `/v3/users/175503211b6e47f28bdf0873d983218e` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:00.945744 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] RBAC: Authorizing `identity:delete_user(user_id=175503211b6e47f28bdf0873d983218e)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:00.945934 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1248/2518] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:00.947825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:00.949848 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cad974-3c1d-47bc-9680-cab97192d5b4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:00.960427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cad974-3c1d-47bc-9680-cab97192d5b4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:00.965164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af2f42-623b-43ba-8769-9dceb472808b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:00.965994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af2f42-623b-43ba-8769-9dceb472808b admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:00.966275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af2f42-623b-43ba-8769-9dceb472808b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:00.966548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00af2f42-623b-43ba-8769-9dceb472808b admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:00.967241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af2f42-623b-43ba-8769-9dceb472808b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:00.968837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00af2f42-623b-43ba-8769-9dceb472808b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:00.980406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1249/2519] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:00.985103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af2f42-623b-43ba-8769-9dceb472808b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:00.996363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00af2f42-623b-43ba-8769-9dceb472808b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:00.998532 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '175503211b6e47f28bdf0873d983218e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.001232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56406522-cc49-4a53-bc70-c6d0edbc3b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:01.001879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56406522-cc49-4a53-bc70-c6d0edbc3b41 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.002162 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56406522-cc49-4a53-bc70-c6d0edbc3b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.002889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56406522-cc49-4a53-bc70-c6d0edbc3b41 admin admin] PATH_INFO: `/v3/projects/cb015e45e032427694b215d168f9f099/users/5ce191041b994a03a6ebaef88212863a/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.011098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '175503211b6e47f28bdf0873d983218e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.020120 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '175503211b6e47f28bdf0873d983218e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.020880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56406522-cc49-4a53-bc70-c6d0edbc3b41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb015e45e032427694b215d168f9f099, user_id=5ce191041b994a03a6ebaef88212863a, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:01.023847 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56406522-cc49-4a53-bc70-c6d0edbc3b41 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:01.027728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '175503211b6e47f28bdf0873d983218e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.028434 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-6d65c0c1-e508-4782-ad33-398f4ae5f541 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '175503211b6e47f28bdf0873d983218e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.035128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1271/2520] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:00 2022] DELETE /identity/v3/users/175503211b6e47f28bdf0873d983218e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:01.038298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1250/2521] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:00 2022] PUT /identity/v3/projects/cb015e45e032427694b215d168f9f099/users/5ce191041b994a03a6ebaef88212863a/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:01.049740 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55701cdb-a3c4-487b-a070-cbe13efa1833 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.050049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55701cdb-a3c4-487b-a070-cbe13efa1833 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.050320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55701cdb-a3c4-487b-a070-cbe13efa1833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.079837 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-55701cdb-a3c4-487b-a070-cbe13efa1833 None None] MFA Rules not processed for user `5ce191041b994a03a6ebaef88212863a`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:01.081107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-55701cdb-a3c4-487b-a070-cbe13efa1833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:01.149369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1272/2522] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:01.154064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56406522-cc49-4a53-bc70-c6d0edbc3b41 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:01.155891 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-56406522-cc49-4a53-bc70-c6d0edbc3b41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:01.212410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:01.216687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55701cdb-a3c4-487b-a070-cbe13efa1833 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:01.218305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-55701cdb-a3c4-487b-a070-cbe13efa1833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:01.236051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56406522-cc49-4a53-bc70-c6d0edbc3b41 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:01.282171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:01.297500 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdcfc3-5d18-4696-81b4-9714d81dbe32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:01.298294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdcfc3-5d18-4696-81b4-9714d81dbe32 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.298631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdcfc3-5d18-4696-81b4-9714d81dbe32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.298946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdcfc3-5d18-4696-81b4-9714d81dbe32 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.299935 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdcfc3-5d18-4696-81b4-9714d81dbe32 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:01.301910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdcfc3-5d18-4696-81b4-9714d81dbe32 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:01.303333 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55701cdb-a3c4-487b-a070-cbe13efa1833 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:01.308152 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:01.308843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.309122 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.309393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] PATH_INFO: `/v3/projects/8d728a1ecfac41f78fe6e606a3630b02` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.310539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d728a1ecfac41f78fe6e606a3630b02)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:01.312547 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:01.332529 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1251/2523] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:01 2022] POST /identity/v3/projects => generated 407 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:01.333551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdcfc3-5d18-4696-81b4-9714d81dbe32 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:01.365394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d728a1ecfac41f78fe6e606a3630b02', 'request_id': 'req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.371553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d728a1ecfac41f78fe6e606a3630b02', 'request_id': 'req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.381114 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d728a1ecfac41f78fe6e606a3630b02', 'request_id': 'req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.393470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] The token cache is being invalidate because project 8d728a1ecfac41f78fe6e606a3630b02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:01.393880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.394537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.396093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1273/2524] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:01 2022] DELETE /identity/v3/projects/8d728a1ecfac41f78fe6e606a3630b02 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:01.399080 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdcfc3-5d18-4696-81b4-9714d81dbe32 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:01.400017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:01.401327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:01.454686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685580-a960-4073-9dd7-97bc373e4f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:01.455339 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685580-a960-4073-9dd7-97bc373e4f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.455737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685580-a960-4073-9dd7-97bc373e4f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.456175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685580-a960-4073-9dd7-97bc373e4f31 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.457270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05685580-a960-4073-9dd7-97bc373e4f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:01.460018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05685580-a960-4073-9dd7-97bc373e4f31 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:01.466163 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a1e2d2-5322-4312-9c90-dbcbe8d9f9f8 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:01.472548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:01.473462 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.473833 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.474222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] PATH_INFO: `/v3/users/39237e374a2a4cba95f7febe3c9c60a3` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.476078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39237e374a2a4cba95f7febe3c9c60a3)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:01.478102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:01.491359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1252/2525] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:01 2022] POST /identity/v3/users => generated 310 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:01.495585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685580-a960-4073-9dd7-97bc373e4f31 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:01.497206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-05685580-a960-4073-9dd7-97bc373e4f31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:01.511870 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685580-a960-4073-9dd7-97bc373e4f31 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:01.519837 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e053e87-b3be-407a-90e8-6e7128607f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:01.520465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e053e87-b3be-407a-90e8-6e7128607f4a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.520745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e053e87-b3be-407a-90e8-6e7128607f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.521016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e053e87-b3be-407a-90e8-6e7128607f4a admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.521685 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e053e87-b3be-407a-90e8-6e7128607f4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:01.523362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e053e87-b3be-407a-90e8-6e7128607f4a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:01.530230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39237e374a2a4cba95f7febe3c9c60a3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.536229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1253/2526] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:01.540547 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e053e87-b3be-407a-90e8-6e7128607f4a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:01.543336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39237e374a2a4cba95f7febe3c9c60a3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.551039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e053e87-b3be-407a-90e8-6e7128607f4a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:01.552973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39237e374a2a4cba95f7febe3c9c60a3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.556616 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f645-0d72-4a3c-866c-db30cf4600d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:01.557370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f645-0d72-4a3c-866c-db30cf4600d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.558589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f645-0d72-4a3c-866c-db30cf4600d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.558589 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d81f645-0d72-4a3c-866c-db30cf4600d2 admin admin] PATH_INFO: `/v3/projects/a3613201b4c941ce860756a424a8c208/users/76c64de5f48e403a88ee65f1e3f3f137/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.561223 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39237e374a2a4cba95f7febe3c9c60a3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.561957 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39237e374a2a4cba95f7febe3c9c60a3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.562724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:01.564341 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:01.572437 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1274/2527] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:01 2022] DELETE /identity/v3/users/39237e374a2a4cba95f7febe3c9c60a3 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:01.581443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81f645-0d72-4a3c-866c-db30cf4600d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3613201b4c941ce860756a424a8c208, user_id=76c64de5f48e403a88ee65f1e3f3f137, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:01.584155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d81f645-0d72-4a3c-866c-db30cf4600d2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:01.600001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1254/2528] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:01 2022] PUT /identity/v3/projects/a3613201b4c941ce860756a424a8c208/users/76c64de5f48e403a88ee65f1e3f3f137/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:01.604260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:01.605699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:01.678874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc731fb-c873-4ee0-9dcb-91942b8ade75 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:01.741992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a29670-1ee8-41e5-8d47-3495e8c51e35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:01.742683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a29670-1ee8-41e5-8d47-3495e8c51e35 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.743111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a29670-1ee8-41e5-8d47-3495e8c51e35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.743391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a29670-1ee8-41e5-8d47-3495e8c51e35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.744078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a29670-1ee8-41e5-8d47-3495e8c51e35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:01.745849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a29670-1ee8-41e5-8d47-3495e8c51e35 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:01.753809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f645-0d72-4a3c-866c-db30cf4600d2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:01.757563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2d81f645-0d72-4a3c-866c-db30cf4600d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:01.757720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1275/2529] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:01 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:01.761804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a29670-1ee8-41e5-8d47-3495e8c51e35 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:01.777251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a29670-1ee8-41e5-8d47-3495e8c51e35 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:01.780297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d81f645-0d72-4a3c-866c-db30cf4600d2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:01.782760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86120a82-5c47-43f5-824d-9a1dc16d0333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:01.783759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86120a82-5c47-43f5-824d-9a1dc16d0333 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.783887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86120a82-5c47-43f5-824d-9a1dc16d0333 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.784687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86120a82-5c47-43f5-824d-9a1dc16d0333 admin admin] PATH_INFO: `/v3/projects/a3613201b4c941ce860756a424a8c208/users/76c64de5f48e403a88ee65f1e3f3f137/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.787126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86120a82-5c47-43f5-824d-9a1dc16d0333 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3613201b4c941ce860756a424a8c208, user_id=76c64de5f48e403a88ee65f1e3f3f137, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:01.787263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:01.787377 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.787600 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.787874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] PATH_INFO: `/v3/projects/95ba9cf02d7a438eb83c1875f4f54b31` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.789011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=95ba9cf02d7a438eb83c1875f4f54b31)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:01.789364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86120a82-5c47-43f5-824d-9a1dc16d0333 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:01.790975 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:01.807103 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1276/2530] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:01 2022] PUT /identity/v3/projects/a3613201b4c941ce860756a424a8c208/users/76c64de5f48e403a88ee65f1e3f3f137/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:01.817583 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd63dd-7925-422c-98d2-61f9e753f51a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.817866 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd63dd-7925-422c-98d2-61f9e753f51a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.818284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd63dd-7925-422c-98d2-61f9e753f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.852997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ebbd63dd-7925-422c-98d2-61f9e753f51a None None] MFA Rules not processed for user `76c64de5f48e403a88ee65f1e3f3f137`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:01.853244 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95ba9cf02d7a438eb83c1875f4f54b31', 'request_id': 'req-b26792a3-6776-448c-8ac5-481f949235bd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.854283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ebbd63dd-7925-422c-98d2-61f9e753f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:01.861198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95ba9cf02d7a438eb83c1875f4f54b31', 'request_id': 'req-b26792a3-6776-448c-8ac5-481f949235bd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.868294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95ba9cf02d7a438eb83c1875f4f54b31', 'request_id': 'req-b26792a3-6776-448c-8ac5-481f949235bd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.879107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] The token cache is being invalidate because project 95ba9cf02d7a438eb83c1875f4f54b31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:01.879441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.880092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b26792a3-6776-448c-8ac5-481f949235bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:01.881623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1255/2531] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:01 2022] DELETE /identity/v3/projects/95ba9cf02d7a438eb83c1875f4f54b31 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:01.886351 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5208-fc24-415e-934e-b81ee84cca67 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.886642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5208-fc24-415e-934e-b81ee84cca67 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.886952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdf5208-fc24-415e-934e-b81ee84cca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.906938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fcdf5208-fc24-415e-934e-b81ee84cca67 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:01.908171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fcdf5208-fc24-415e-934e-b81ee84cca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:01.929423 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1277/2532] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:01.941372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd63dd-7925-422c-98d2-61f9e753f51a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:01.942818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ebbd63dd-7925-422c-98d2-61f9e753f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:01.962054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:01.969735 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1256/2533] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:01.978807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125195f4-04c1-41d7-86da-4000818522b5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:01.978807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125195f4-04c1-41d7-86da-4000818522b5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:01.979040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125195f4-04c1-41d7-86da-4000818522b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:01.999374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-125195f4-04c1-41d7-86da-4000818522b5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:02.000577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-125195f4-04c1-41d7-86da-4000818522b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:02.009520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1257/2534] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:02.013789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125195f4-04c1-41d7-86da-4000818522b5 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.023397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125195f4-04c1-41d7-86da-4000818522b5 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.027952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3512e9d-f195-4179-acd5-193f61f4a159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.028546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3512e9d-f195-4179-acd5-193f61f4a159 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.028844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3512e9d-f195-4179-acd5-193f61f4a159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.029133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3512e9d-f195-4179-acd5-193f61f4a159 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.029775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3512e9d-f195-4179-acd5-193f61f4a159 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:02.030069 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3512e9d-f195-4179-acd5-193f61f4a159 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.030608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbd63dd-7925-422c-98d2-61f9e753f51a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.031724 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3512e9d-f195-4179-acd5-193f61f4a159 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.035022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37089d2-6ae4-4342-9eb1-6ab5827f85e5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.035630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37089d2-6ae4-4342-9eb1-6ab5827f85e5 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.035908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37089d2-6ae4-4342-9eb1-6ab5827f85e5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.036179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37089d2-6ae4-4342-9eb1-6ab5827f85e5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.043447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1258/2535] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:14:02.047696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3512e9d-f195-4179-acd5-193f61f4a159 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.048530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37089d2-6ae4-4342-9eb1-6ab5827f85e5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.050626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37089d2-6ae4-4342-9eb1-6ab5827f85e5 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.058089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3512e9d-f195-4179-acd5-193f61f4a159 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.060369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1278/2536] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:01 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:14:02.062835 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae3a1a-7fb2-429c-a592-00c91c023e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.063454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae3a1a-7fb2-429c-a592-00c91c023e96 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.063736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae3a1a-7fb2-429c-a592-00c91c023e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.064037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae3a1a-7fb2-429c-a592-00c91c023e96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.065101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae3a1a-7fb2-429c-a592-00c91c023e96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.066663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae3a1a-7fb2-429c-a592-00c91c023e96 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.097375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1259/2537] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:02 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:02.101670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37089d2-6ae4-4342-9eb1-6ab5827f85e5 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.113080 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37089d2-6ae4-4342-9eb1-6ab5827f85e5 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.173651 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9f2b1-73df-432f-b596-f63c1390b3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.174370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9f2b1-73df-432f-b596-f63c1390b3ad admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.174709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9f2b1-73df-432f-b596-f63c1390b3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.175029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e9f2b1-73df-432f-b596-f63c1390b3ad admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.175729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9f2b1-73df-432f-b596-f63c1390b3ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.177729 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e9f2b1-73df-432f-b596-f63c1390b3ad admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.201446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1279/2538] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:02 2022] POST /identity/v3/users => generated 286 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:02.205880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae3a1a-7fb2-429c-a592-00c91c023e96 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.216507 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae3a1a-7fb2-429c-a592-00c91c023e96 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.221764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d7593-2896-40c0-b4eb-097b1d37e4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.222640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d7593-2896-40c0-b4eb-097b1d37e4fb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.222878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d7593-2896-40c0-b4eb-097b1d37e4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.223156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d7593-2896-40c0-b4eb-097b1d37e4fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.223749 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9f2b1-73df-432f-b596-f63c1390b3ad admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.223857 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d7593-2896-40c0-b4eb-097b1d37e4fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.225390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d7593-2896-40c0-b4eb-097b1d37e4fb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.236047 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1260/2539] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:02.240113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d7593-2896-40c0-b4eb-097b1d37e4fb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.250658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d7593-2896-40c0-b4eb-097b1d37e4fb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.255566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8d6a6-4bc1-40ba-9870-f15a5a60e1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.256120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8d6a6-4bc1-40ba-9870-f15a5a60e1d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.256397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8d6a6-4bc1-40ba-9870-f15a5a60e1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.256661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae8d6a6-4bc1-40ba-9870-f15a5a60e1d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.257289 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8d6a6-4bc1-40ba-9870-f15a5a60e1d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.258899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae8d6a6-4bc1-40ba-9870-f15a5a60e1d4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.269520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1261/2540] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:02.273767 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8d6a6-4bc1-40ba-9870-f15a5a60e1d4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.280754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:02.282384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e9f2b1-73df-432f-b596-f63c1390b3ad admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.285105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae8d6a6-4bc1-40ba-9870-f15a5a60e1d4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.286121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1cca3-aa91-4459-b2a1-cb27038f9ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.286722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1cca3-aa91-4459-b2a1-cb27038f9ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.287029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1cca3-aa91-4459-b2a1-cb27038f9ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.287293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1cca3-aa91-4459-b2a1-cb27038f9ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.289263 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ace1cca3-aa91-4459-b2a1-cb27038f9ff4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:02.292295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c5a684-3c7e-4da8-adc0-522f945d7ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.292943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5a684-3c7e-4da8-adc0-522f945d7ab4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.293467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5a684-3c7e-4da8-adc0-522f945d7ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.294235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c5a684-3c7e-4da8-adc0-522f945d7ab4 admin admin] PATH_INFO: `/v3/projects/d9fc7b0ceb3d4517b89caeb4d74167f6/users/98de8c14da0145638cddeffe82e1c7d4/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.311410 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5a684-3c7e-4da8-adc0-522f945d7ab4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d9fc7b0ceb3d4517b89caeb4d74167f6, user_id=98de8c14da0145638cddeffe82e1c7d4, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.314107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c5a684-3c7e-4da8-adc0-522f945d7ab4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.328757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1262/2541] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:02 2022] PUT /identity/v3/projects/d9fc7b0ceb3d4517b89caeb4d74167f6/users/98de8c14da0145638cddeffe82e1c7d4/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:02.339145 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:02.341710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7f51-27d2-413b-a953-cdd71174448b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.342080 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7f51-27d2-413b-a953-cdd71174448b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.342495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12e7f51-27d2-413b-a953-cdd71174448b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.353044 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1cca3-aa91-4459-b2a1-cb27038f9ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.354540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1cca3-aa91-4459-b2a1-cb27038f9ff4 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.363715 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1280/2542] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:02.374458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a12e7f51-27d2-413b-a953-cdd71174448b None None] MFA Rules not processed for user `98de8c14da0145638cddeffe82e1c7d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:02.375733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a12e7f51-27d2-413b-a953-cdd71174448b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:02.444482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1263/2543] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:02.449625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1cca3-aa91-4459-b2a1-cb27038f9ff4 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.461637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1cca3-aa91-4459-b2a1-cb27038f9ff4 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.524978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00301b-8acb-4f58-ba6a-4220277f3755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.525660 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00301b-8acb-4f58-ba6a-4220277f3755 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.526038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00301b-8acb-4f58-ba6a-4220277f3755 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.526309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00301b-8acb-4f58-ba6a-4220277f3755 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.527003 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00301b-8acb-4f58-ba6a-4220277f3755 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.529130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b00301b-8acb-4f58-ba6a-4220277f3755 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.560642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1281/2544] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:02 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:02.564788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7f51-27d2-413b-a953-cdd71174448b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.575905 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12e7f51-27d2-413b-a953-cdd71174448b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.642198 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4000f-6c19-48b5-80a4-90c77a693a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.643094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4000f-6c19-48b5-80a4-90c77a693a12 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.643470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4000f-6c19-48b5-80a4-90c77a693a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.643953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c4000f-6c19-48b5-80a4-90c77a693a12 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.644788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4000f-6c19-48b5-80a4-90c77a693a12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.646998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c4000f-6c19-48b5-80a4-90c77a693a12 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.677238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1264/2545] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:02 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:02.681484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00301b-8acb-4f58-ba6a-4220277f3755 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.695925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00301b-8acb-4f58-ba6a-4220277f3755 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.700686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266c31b-54f3-43e1-9bdc-0eb844d82e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.701297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c31b-54f3-43e1-9bdc-0eb844d82e5d admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.701572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c31b-54f3-43e1-9bdc-0eb844d82e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.701841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266c31b-54f3-43e1-9bdc-0eb844d82e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.702485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266c31b-54f3-43e1-9bdc-0eb844d82e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.704135 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266c31b-54f3-43e1-9bdc-0eb844d82e5d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.716069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1282/2546] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:02.720690 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4000f-6c19-48b5-80a4-90c77a693a12 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.731784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c4000f-6c19-48b5-80a4-90c77a693a12 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.736432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700125b-6526-43d0-be74-d5f9d1e2039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.737157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700125b-6526-43d0-be74-d5f9d1e2039e admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.737437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700125b-6526-43d0-be74-d5f9d1e2039e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.737769 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700125b-6526-43d0-be74-d5f9d1e2039e admin admin] PATH_INFO: `/v3/projects/a6abc80e14574f119507af870bd088e6/users/9ddb8945684d499b8ca697a504077042/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.753517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700125b-6526-43d0-be74-d5f9d1e2039e admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6abc80e14574f119507af870bd088e6, user_id=9ddb8945684d499b8ca697a504077042, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.756274 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700125b-6526-43d0-be74-d5f9d1e2039e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.770233 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1265/2547] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:02 2022] PUT /identity/v3/projects/a6abc80e14574f119507af870bd088e6/users/9ddb8945684d499b8ca697a504077042/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:02.774300 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266c31b-54f3-43e1-9bdc-0eb844d82e5d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.784477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266c31b-54f3-43e1-9bdc-0eb844d82e5d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.843491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700125b-6526-43d0-be74-d5f9d1e2039e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.845391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a700125b-6526-43d0-be74-d5f9d1e2039e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:02.858429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79ad43-1b1b-4d8d-a740-9952067cb41c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.859162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ad43-1b1b-4d8d-a740-9952067cb41c admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.859408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ad43-1b1b-4d8d-a740-9952067cb41c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.859870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f79ad43-1b1b-4d8d-a740-9952067cb41c admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.860494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79ad43-1b1b-4d8d-a740-9952067cb41c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.862247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f79ad43-1b1b-4d8d-a740-9952067cb41c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.873877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1283/2548] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:02 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:02.878174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79ad43-1b1b-4d8d-a740-9952067cb41c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:02.887690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f79ad43-1b1b-4d8d-a740-9952067cb41c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.890808 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:02.892579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7d0c4c-771e-4d82-a6ff-920f98131a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.893297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d0c4c-771e-4d82-a6ff-920f98131a34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.893767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d0c4c-771e-4d82-a6ff-920f98131a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.894100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7d0c4c-771e-4d82-a6ff-920f98131a34 admin admin] PATH_INFO: `/v3/projects/a6abc80e14574f119507af870bd088e6/users/9ddb8945684d499b8ca697a504077042/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.896110 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d0c4c-771e-4d82-a6ff-920f98131a34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6abc80e14574f119507af870bd088e6, user_id=9ddb8945684d499b8ca697a504077042, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:02.899136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7d0c4c-771e-4d82-a6ff-920f98131a34 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:02.910127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1284/2549] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:02 2022] PUT /identity/v3/projects/a6abc80e14574f119507af870bd088e6/users/9ddb8945684d499b8ca697a504077042/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:02.911703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700125b-6526-43d0-be74-d5f9d1e2039e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:02.920123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536976e-f1a5-470f-8146-d79bab246532 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.920410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536976e-f1a5-470f-8146-d79bab246532 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.920688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8536976e-f1a5-470f-8146-d79bab246532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.950323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-8536976e-f1a5-470f-8146-d79bab246532 None None] MFA Rules not processed for user `9ddb8945684d499b8ca697a504077042`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:02.952176 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8536976e-f1a5-470f-8146-d79bab246532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:02.962230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bc83a-316b-45cf-9d0e-671a1063f397 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:02.963005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bc83a-316b-45cf-9d0e-671a1063f397 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:02.963388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bc83a-316b-45cf-9d0e-671a1063f397 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:02.963658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0bc83a-316b-45cf-9d0e-671a1063f397 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:02.965413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5f0bc83a-316b-45cf-9d0e-671a1063f397 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:02.981499 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:03.027477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1285/2550] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:03.036565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bc83a-316b-45cf-9d0e-671a1063f397 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:03.038075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0bc83a-316b-45cf-9d0e-671a1063f397 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:03.038979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536976e-f1a5-470f-8146-d79bab246532 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:03.049213 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8536976e-f1a5-470f-8146-d79bab246532 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:03.049926 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1266/2551] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:02 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:03.053269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9fc4a1-4f44-4f53-9917-5466ea4cbafa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:03.053880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fc4a1-4f44-4f53-9917-5466ea4cbafa service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:03.054159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fc4a1-4f44-4f53-9917-5466ea4cbafa service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:03.054430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9fc4a1-4f44-4f53-9917-5466ea4cbafa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:03.064355 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fc4a1-4f44-4f53-9917-5466ea4cbafa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:03.066087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9fc4a1-4f44-4f53-9917-5466ea4cbafa service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:03.078050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1286/2552] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:03.500584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bc83a-316b-45cf-9d0e-671a1063f397 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:03.573887 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0bc83a-316b-45cf-9d0e-671a1063f397 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:03.578530 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:03.579186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:03.579460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:03.579726 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] PATH_INFO: `/v3/users/98de8c14da0145638cddeffe82e1c7d4` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:03.580929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] RBAC: Authorizing `identity:delete_user(user_id=98de8c14da0145638cddeffe82e1c7d4)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:03.583113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:03.644033 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:03.646599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98de8c14da0145638cddeffe82e1c7d4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:03.647635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98de8c14da0145638cddeffe82e1c7d4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:03.648789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98de8c14da0145638cddeffe82e1c7d4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:03.661635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98de8c14da0145638cddeffe82e1c7d4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:03.670797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98de8c14da0145638cddeffe82e1c7d4'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:03.683705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1267/2553] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:03 2022] DELETE /identity/v3/users/98de8c14da0145638cddeffe82e1c7d4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:03.688345 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeda5f1-e828-412e-ac0c-781fe0697798 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:03.688840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeda5f1-e828-412e-ac0c-781fe0697798 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:03.688956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeda5f1-e828-412e-ac0c-781fe0697798 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:03.718034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-aaeda5f1-e828-412e-ac0c-781fe0697798 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:03.721291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-aaeda5f1-e828-412e-ac0c-781fe0697798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:03.789484 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1287/2554] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:03.799697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:03.801396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:03.885898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638128f9-89b9-4e02-9163-1148e057fb0b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:03.890904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a1d69-6deb-496d-91d3-f9ad3b723ee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:03.891873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a1d69-6deb-496d-91d3-f9ad3b723ee5 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:03.892194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a1d69-6deb-496d-91d3-f9ad3b723ee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:03.892439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a1d69-6deb-496d-91d3-f9ad3b723ee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:03.903610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a1d69-6deb-496d-91d3-f9ad3b723ee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:03.905066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a1d69-6deb-496d-91d3-f9ad3b723ee5 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:03.920467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1268/2555] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:14:04.214786 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeda5f1-e828-412e-ac0c-781fe0697798 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:04.216271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-aaeda5f1-e828-412e-ac0c-781fe0697798 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:04.231268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeda5f1-e828-412e-ac0c-781fe0697798 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:04.236151 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:04.237352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:04.237352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:04.237352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] PATH_INFO: `/v3/projects/d9fc7b0ceb3d4517b89caeb4d74167f6` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:04.238522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d9fc7b0ceb3d4517b89caeb4d74167f6)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:04.241066 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:04.292163 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd9fc7b0ceb3d4517b89caeb4d74167f6', 'request_id': 'req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.297993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd9fc7b0ceb3d4517b89caeb4d74167f6', 'request_id': 'req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.306932 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd9fc7b0ceb3d4517b89caeb4d74167f6', 'request_id': 'req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.318186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] The token cache is being invalidate because project d9fc7b0ceb3d4517b89caeb4d74167f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:04.318475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.319315 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.321199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1288/2556] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:04 2022] DELETE /identity/v3/projects/d9fc7b0ceb3d4517b89caeb4d74167f6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:04.325586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a1d69-6deb-496d-91d3-f9ad3b723ee5 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:04.335621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a1d69-6deb-496d-91d3-f9ad3b723ee5 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:04.401207 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:04.401748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:04.402017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:04.402284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] PATH_INFO: `/v3/users/9ddb8945684d499b8ca697a504077042` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:04.403541 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ddb8945684d499b8ca697a504077042)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:04.405518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:04.457845 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ddb8945684d499b8ca697a504077042'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.458523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ddb8945684d499b8ca697a504077042'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.459175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ddb8945684d499b8ca697a504077042'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.471326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ddb8945684d499b8ca697a504077042'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.473293 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:04.480796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5af51d5d-13bb-4d30-bf0e-a1395ade1703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ddb8945684d499b8ca697a504077042'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.494131 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1269/2557] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:04 2022] DELETE /identity/v3/users/9ddb8945684d499b8ca697a504077042 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:04.775968 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:04.777650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:04.792091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c207bb73-4403-42f9-b3fb-d115c5a3ba7d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:04.824146 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:04.853344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:04.853989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:04.854272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:04.854546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] PATH_INFO: `/v3/projects/a6abc80e14574f119507af870bd088e6` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:04.855700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6abc80e14574f119507af870bd088e6)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:04.857694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:04.905891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6abc80e14574f119507af870bd088e6', 'request_id': 'req-5cf66072-1254-4cc1-8f49-a1d174a9f552'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.912507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6abc80e14574f119507af870bd088e6', 'request_id': 'req-5cf66072-1254-4cc1-8f49-a1d174a9f552'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.921698 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6abc80e14574f119507af870bd088e6', 'request_id': 'req-5cf66072-1254-4cc1-8f49-a1d174a9f552'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.933920 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] The token cache is being invalidate because project a6abc80e14574f119507af870bd088e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:04.934209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.934979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-5cf66072-1254-4cc1-8f49-a1d174a9f552 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:04.936495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1289/2558] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:04 2022] DELETE /identity/v3/projects/a6abc80e14574f119507af870bd088e6 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:04.943681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83b32-5fd4-4d72-873a-0b12e22f77e0 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:04.944395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83b32-5fd4-4d72-873a-0b12e22f77e0 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:04.944395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c83b32-5fd4-4d72-873a-0b12e22f77e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:04.971860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-57c83b32-5fd4-4d72-873a-0b12e22f77e0 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:04.973074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-57c83b32-5fd4-4d72-873a-0b12e22f77e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:05.041129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1270/2559] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:05.050259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5d5d-8e16-40b5-a0aa-c22c064b4be5 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.050564 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5d5d-8e16-40b5-a0aa-c22c064b4be5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.050875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a5d5d-8e16-40b5-a0aa-c22c064b4be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.071937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-3f8a5d5d-8e16-40b5-a0aa-c22c064b4be5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:05.073160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3f8a5d5d-8e16-40b5-a0aa-c22c064b4be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:05.083297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1290/2560] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:05.087850 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c83b32-5fd4-4d72-873a-0b12e22f77e0 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.099911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c83b32-5fd4-4d72-873a-0b12e22f77e0 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.105213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798a563-4c57-4e1e-9037-5f11ee828f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.105806 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798a563-4c57-4e1e-9037-5f11ee828f6f admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.106079 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798a563-4c57-4e1e-9037-5f11ee828f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.106345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798a563-4c57-4e1e-9037-5f11ee828f6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.107027 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798a563-4c57-4e1e-9037-5f11ee828f6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:05.107327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798a563-4c57-4e1e-9037-5f11ee828f6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.108930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798a563-4c57-4e1e-9037-5f11ee828f6f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.121635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1271/2561] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:14:05.126222 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5d5d-8e16-40b5-a0aa-c22c064b4be5 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.135894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a5d5d-8e16-40b5-a0aa-c22c064b4be5 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.141544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b43ea-db6f-494e-b711-f17ba658384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.142159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b43ea-db6f-494e-b711-f17ba658384f admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.142417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b43ea-db6f-494e-b711-f17ba658384f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.142674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6b43ea-db6f-494e-b711-f17ba658384f admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.143506 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b43ea-db6f-494e-b711-f17ba658384f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.145428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6b43ea-db6f-494e-b711-f17ba658384f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.177838 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1291/2562] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:05 2022] POST /identity/v3/projects => generated 357 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:05.182235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798a563-4c57-4e1e-9037-5f11ee828f6f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.193737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798a563-4c57-4e1e-9037-5f11ee828f6f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.256771 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98502382-2321-4432-9b74-3b6c747c8028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.257723 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98502382-2321-4432-9b74-3b6c747c8028 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.258139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98502382-2321-4432-9b74-3b6c747c8028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.258598 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98502382-2321-4432-9b74-3b6c747c8028 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.259670 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98502382-2321-4432-9b74-3b6c747c8028 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.262827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98502382-2321-4432-9b74-3b6c747c8028 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.299175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1272/2563] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:05 2022] POST /identity/v3/users => generated 279 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:05.303733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b43ea-db6f-494e-b711-f17ba658384f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.314603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6b43ea-db6f-494e-b711-f17ba658384f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.321211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03df97-9be4-4391-841f-d562e282d61c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.321816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03df97-9be4-4391-841f-d562e282d61c admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.322097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03df97-9be4-4391-841f-d562e282d61c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.322363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03df97-9be4-4391-841f-d562e282d61c admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.323065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03df97-9be4-4391-841f-d562e282d61c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.324673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03df97-9be4-4391-841f-d562e282d61c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.335804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1292/2564] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:05.339979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98502382-2321-4432-9b74-3b6c747c8028 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.350815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98502382-2321-4432-9b74-3b6c747c8028 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.357313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d8a9c2-a9ad-4d4c-ad57-a9aef5cfdc4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.357918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8a9c2-a9ad-4d4c-ad57-a9aef5cfdc4d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.358217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8a9c2-a9ad-4d4c-ad57-a9aef5cfdc4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.358447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d8a9c2-a9ad-4d4c-ad57-a9aef5cfdc4d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.359132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8a9c2-a9ad-4d4c-ad57-a9aef5cfdc4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.360755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d8a9c2-a9ad-4d4c-ad57-a9aef5cfdc4d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.372789 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1273/2565] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:05.377867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03df97-9be4-4391-841f-d562e282d61c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.393383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03df97-9be4-4391-841f-d562e282d61c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.399617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa92e6-3716-4bf9-abfb-afafa45b9ccc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.400265 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa92e6-3716-4bf9-abfb-afafa45b9ccc admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.400538 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa92e6-3716-4bf9-abfb-afafa45b9ccc admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.400874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0daa92e6-3716-4bf9-abfb-afafa45b9ccc admin admin] PATH_INFO: `/v3/projects/9a533ed12a3a4b47a9bbd85638b3b0d8/users/5156400d2b8e477e8b3aab2c2ba7ff1d/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.417996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa92e6-3716-4bf9-abfb-afafa45b9ccc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a533ed12a3a4b47a9bbd85638b3b0d8, user_id=5156400d2b8e477e8b3aab2c2ba7ff1d, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.421263 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0daa92e6-3716-4bf9-abfb-afafa45b9ccc admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.441334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1293/2566] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:05 2022] PUT /identity/v3/projects/9a533ed12a3a4b47a9bbd85638b3b0d8/users/5156400d2b8e477e8b3aab2c2ba7ff1d/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:05.453594 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a0a4f-d590-44ec-9f9b-152ff26469e2 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.453879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a0a4f-d590-44ec-9f9b-152ff26469e2 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.454157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53a0a4f-d590-44ec-9f9b-152ff26469e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.482532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a53a0a4f-d590-44ec-9f9b-152ff26469e2 None None] MFA Rules not processed for user `5156400d2b8e477e8b3aab2c2ba7ff1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:05.483819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a53a0a4f-d590-44ec-9f9b-152ff26469e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:05.530002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:05.561036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1274/2567] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:05 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:05.566138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa92e6-3716-4bf9-abfb-afafa45b9ccc admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.643314 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0daa92e6-3716-4bf9-abfb-afafa45b9ccc admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.649799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a396d0-b16f-472d-8caa-d348c198c69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.650710 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a396d0-b16f-472d-8caa-d348c198c69d admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.651208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a396d0-b16f-472d-8caa-d348c198c69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.651500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a396d0-b16f-472d-8caa-d348c198c69d admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.652401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a396d0-b16f-472d-8caa-d348c198c69d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.655161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a396d0-b16f-472d-8caa-d348c198c69d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.661260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:05.688502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1294/2568] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:05 2022] POST /identity/v3/projects => generated 357 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:05.693090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a0a4f-d590-44ec-9f9b-152ff26469e2 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.704494 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a53a0a4f-d590-44ec-9f9b-152ff26469e2 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.770164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d340e-99d9-4e79-a39e-461f5aa341f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.770864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d340e-99d9-4e79-a39e-461f5aa341f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.771149 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d340e-99d9-4e79-a39e-461f5aa341f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.771424 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745d340e-99d9-4e79-a39e-461f5aa341f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.772417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d340e-99d9-4e79-a39e-461f5aa341f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.774051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745d340e-99d9-4e79-a39e-461f5aa341f1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.799725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1275/2569] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:05 2022] POST /identity/v3/users => generated 285 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:05.804065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a396d0-b16f-472d-8caa-d348c198c69d admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.814579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a396d0-b16f-472d-8caa-d348c198c69d admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.819967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babcb68-7c7d-4e66-8c8c-6e0c33814d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.820570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babcb68-7c7d-4e66-8c8c-6e0c33814d60 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.820841 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babcb68-7c7d-4e66-8c8c-6e0c33814d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.821101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4babcb68-7c7d-4e66-8c8c-6e0c33814d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.821769 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babcb68-7c7d-4e66-8c8c-6e0c33814d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.823427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4babcb68-7c7d-4e66-8c8c-6e0c33814d60 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.834224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1295/2570] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:05.838657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d340e-99d9-4e79-a39e-461f5aa341f1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.849348 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745d340e-99d9-4e79-a39e-461f5aa341f1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.854595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54801-133a-44ec-aeec-8c0e0f14f6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.855294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54801-133a-44ec-aeec-8c0e0f14f6d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.855657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54801-133a-44ec-aeec-8c0e0f14f6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.855933 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc54801-133a-44ec-aeec-8c0e0f14f6d4 admin admin] PATH_INFO: `/v3/projects/9c55a0a2c42743c2b65d291a35735e66/users/e925dde6d9244b94972070b2ca777e3c/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.871978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc54801-133a-44ec-aeec-8c0e0f14f6d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c55a0a2c42743c2b65d291a35735e66, user_id=e925dde6d9244b94972070b2ca777e3c, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.874691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc54801-133a-44ec-aeec-8c0e0f14f6d4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.889979 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1276/2571] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:05 2022] PUT /identity/v3/projects/9c55a0a2c42743c2b65d291a35735e66/users/e925dde6d9244b94972070b2ca777e3c/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:05.894586 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babcb68-7c7d-4e66-8c8c-6e0c33814d60 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.904969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4babcb68-7c7d-4e66-8c8c-6e0c33814d60 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:05.968930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2f83f-54b0-4601-909c-f7a292152145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:05.969450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2f83f-54b0-4601-909c-f7a292152145 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:05.969726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2f83f-54b0-4601-909c-f7a292152145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:05.969994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2f83f-54b0-4601-909c-f7a292152145 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:05.970631 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2f83f-54b0-4601-909c-f7a292152145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:05.972328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2f83f-54b0-4601-909c-f7a292152145 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:05.983503 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1296/2572] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:05.987795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54801-133a-44ec-aeec-8c0e0f14f6d4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:05.998651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc54801-133a-44ec-aeec-8c0e0f14f6d4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:06.004845 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f61b3d-c40c-4659-8986-53a4c1b09d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:06.005693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61b3d-c40c-4659-8986-53a4c1b09d7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:06.006136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61b3d-c40c-4659-8986-53a4c1b09d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:06.006476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f61b3d-c40c-4659-8986-53a4c1b09d7f admin admin] PATH_INFO: `/v3/projects/9c55a0a2c42743c2b65d291a35735e66/users/e925dde6d9244b94972070b2ca777e3c/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:06.008749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f61b3d-c40c-4659-8986-53a4c1b09d7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c55a0a2c42743c2b65d291a35735e66, user_id=e925dde6d9244b94972070b2ca777e3c, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:06.011548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f61b3d-c40c-4659-8986-53a4c1b09d7f admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:06.023485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1277/2573] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:05 2022] PUT /identity/v3/projects/9c55a0a2c42743c2b65d291a35735e66/users/e925dde6d9244b94972070b2ca777e3c/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:06.034202 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283564c-135c-4fa5-946d-33aa49a7aec7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:06.034488 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283564c-135c-4fa5-946d-33aa49a7aec7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:06.034808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d283564c-135c-4fa5-946d-33aa49a7aec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:06.064250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d283564c-135c-4fa5-946d-33aa49a7aec7 None None] MFA Rules not processed for user `e925dde6d9244b94972070b2ca777e3c`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:06.065574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d283564c-135c-4fa5-946d-33aa49a7aec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:06.142235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1297/2574] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:06.154173 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f61b3d-c40c-4659-8986-53a4c1b09d7f admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:06.155939 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-27f61b3d-c40c-4659-8986-53a4c1b09d7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:06.213192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f61b3d-c40c-4659-8986-53a4c1b09d7f admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:06.218117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6da66-6ff8-4c93-a4f1-2b05e698f525 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:06.218715 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6da66-6ff8-4c93-a4f1-2b05e698f525 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:06.219098 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6da66-6ff8-4c93-a4f1-2b05e698f525 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:06.219252 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d6da66-6ff8-4c93-a4f1-2b05e698f525 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:06.230368 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6da66-6ff8-4c93-a4f1-2b05e698f525 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:06.231867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d6da66-6ff8-4c93-a4f1-2b05e698f525 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:06.242545 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1278/2575] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:06.326165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283564c-135c-4fa5-946d-33aa49a7aec7 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:06.337687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d283564c-135c-4fa5-946d-33aa49a7aec7 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:06.341696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8fa6a6-9ca6-4997-8eda-8b0b9637207c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:06.342303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fa6a6-9ca6-4997-8eda-8b0b9637207c service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:06.342579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fa6a6-9ca6-4997-8eda-8b0b9637207c service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:06.342884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8fa6a6-9ca6-4997-8eda-8b0b9637207c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:06.411410 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:06.416094 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fa6a6-9ca6-4997-8eda-8b0b9637207c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:06.417946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8fa6a6-9ca6-4997-8eda-8b0b9637207c service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:06.428332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1298/2576] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:06 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:15.044159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6da66-6ff8-4c93-a4f1-2b05e698f525 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:15.045888 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d6d6da66-6ff8-4c93-a4f1-2b05e698f525 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:15.086580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:15.120687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d6da66-6ff8-4c93-a4f1-2b05e698f525 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:15.125695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:15.126272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:15.126543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:15.126843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] PATH_INFO: `/v3/users/5ce191041b994a03a6ebaef88212863a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:15.128003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ce191041b994a03a6ebaef88212863a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:15.130123 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:15.179755 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ce191041b994a03a6ebaef88212863a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.180424 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ce191041b994a03a6ebaef88212863a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.181057 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ce191041b994a03a6ebaef88212863a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.194488 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ce191041b994a03a6ebaef88212863a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.202833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ce191041b994a03a6ebaef88212863a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.214993 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1279/2577] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:15 2022] DELETE /identity/v3/users/5ce191041b994a03a6ebaef88212863a => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:15.219810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc9882-c418-453c-8c38-8206245c9538 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:15.220424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc9882-c418-453c-8c38-8206245c9538 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:15.220424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bc9882-c418-453c-8c38-8206245c9538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:15.241037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-77bc9882-c418-453c-8c38-8206245c9538 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:15.242709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-77bc9882-c418-453c-8c38-8206245c9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:15.309061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1299/2578] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:15.319821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:15.322259 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:15.388415 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1440bf-41d6-40f1-b326-a07498925801 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:15.392451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073c629-086f-41f9-ab09-571820d4d4bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:15.393120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073c629-086f-41f9-ab09-571820d4d4bb service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:15.393401 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073c629-086f-41f9-ab09-571820d4d4bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:15.393675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f073c629-086f-41f9-ab09-571820d4d4bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:15.403859 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073c629-086f-41f9-ab09-571820d4d4bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:15.405500 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f073c629-086f-41f9-ab09-571820d4d4bb service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:15.416785 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1280/2579] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:15.713219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc9882-c418-453c-8c38-8206245c9538 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:15.714722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-77bc9882-c418-453c-8c38-8206245c9538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:15.727439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bc9882-c418-453c-8c38-8206245c9538 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:15.732273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:15.732944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:15.733223 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:15.733494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] PATH_INFO: `/v3/projects/cb015e45e032427694b215d168f9f099` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:15.734612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb015e45e032427694b215d168f9f099)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:15.736615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:15.802709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb015e45e032427694b215d168f9f099', 'request_id': 'req-0a607cd7-a171-4164-a56d-55e4370bd347'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.808428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb015e45e032427694b215d168f9f099', 'request_id': 'req-0a607cd7-a171-4164-a56d-55e4370bd347'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.816303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb015e45e032427694b215d168f9f099', 'request_id': 'req-0a607cd7-a171-4164-a56d-55e4370bd347'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.827790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] The token cache is being invalidate because project cb015e45e032427694b215d168f9f099 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:15.828101 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.828776 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.830415 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1300/2580] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:15 2022] DELETE /identity/v3/projects/cb015e45e032427694b215d168f9f099 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:15.835521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073c629-086f-41f9-ab09-571820d4d4bb service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:15.846246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f073c629-086f-41f9-ab09-571820d4d4bb service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:15.899974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:15.911437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:15.912075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:15.912356 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:15.912635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] PATH_INFO: `/v3/users/76c64de5f48e403a88ee65f1e3f3f137` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:15.914154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=76c64de5f48e403a88ee65f1e3f3f137)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:15.916456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:15.970122 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '76c64de5f48e403a88ee65f1e3f3f137'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.970802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '76c64de5f48e403a88ee65f1e3f3f137'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.971458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '76c64de5f48e403a88ee65f1e3f3f137'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.985381 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '76c64de5f48e403a88ee65f1e3f3f137'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:15.994932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-a7476ed6-3c11-4e42-bc14-bd2164aca8cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '76c64de5f48e403a88ee65f1e3f3f137'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:16.007591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1281/2581] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:15 2022] DELETE /identity/v3/users/76c64de5f48e403a88ee65f1e3f3f137 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:16.307537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:16.309134 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:16.326743 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a607cd7-a171-4164-a56d-55e4370bd347 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:16.399861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:16.400497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:16.400772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:16.401043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] PATH_INFO: `/v3/projects/a3613201b4c941ce860756a424a8c208` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:16.402206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3613201b4c941ce860756a424a8c208)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:16.404171 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:16.426880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:16.456043 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3613201b4c941ce860756a424a8c208', 'request_id': 'req-665520ff-9e76-4718-a5d2-a9e36febab52'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:16.462702 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3613201b4c941ce860756a424a8c208', 'request_id': 'req-665520ff-9e76-4718-a5d2-a9e36febab52'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:16.472443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3613201b4c941ce860756a424a8c208', 'request_id': 'req-665520ff-9e76-4718-a5d2-a9e36febab52'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:16.483805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] The token cache is being invalidate because project a3613201b4c941ce860756a424a8c208 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:16.484092 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:16.484736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-665520ff-9e76-4718-a5d2-a9e36febab52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:16.486242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1301/2582] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:16 2022] DELETE /identity/v3/projects/a3613201b4c941ce860756a424a8c208 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:16.491535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c8057-5c8f-4fe3-83d3-b57fa4d130ae None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:16.492024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c8057-5c8f-4fe3-83d3-b57fa4d130ae None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:16.492141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1c8057-5c8f-4fe3-83d3-b57fa4d130ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:16.512716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ef1c8057-5c8f-4fe3-83d3-b57fa4d130ae None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:16.513944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ef1c8057-5c8f-4fe3-83d3-b57fa4d130ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:16.588223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1282/2583] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:16.597782 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9557364-9fff-4733-96f3-e3a6303aa55e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:16.598069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9557364-9fff-4733-96f3-e3a6303aa55e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:16.598332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9557364-9fff-4733-96f3-e3a6303aa55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:16.620748 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-d9557364-9fff-4733-96f3-e3a6303aa55e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:16.621972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d9557364-9fff-4733-96f3-e3a6303aa55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:16.631535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1302/2584] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:16.636809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c8057-5c8f-4fe3-83d3-b57fa4d130ae None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:16.649355 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1c8057-5c8f-4fe3-83d3-b57fa4d130ae None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:16.654695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4421eaa-65c3-4533-bb31-3cc52293189e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:16.655359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4421eaa-65c3-4533-bb31-3cc52293189e admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:16.655638 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4421eaa-65c3-4533-bb31-3cc52293189e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:16.655907 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4421eaa-65c3-4533-bb31-3cc52293189e admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:16.656567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4421eaa-65c3-4533-bb31-3cc52293189e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:16.656872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4421eaa-65c3-4533-bb31-3cc52293189e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:16.658586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4421eaa-65c3-4533-bb31-3cc52293189e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:16.671630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1283/2585] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:14:16.676025 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9557364-9fff-4733-96f3-e3a6303aa55e None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:16.686059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9557364-9fff-4733-96f3-e3a6303aa55e None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:16.691636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888580b-60d2-477f-a441-246a51db23fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:16.692245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888580b-60d2-477f-a441-246a51db23fd admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:16.692522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888580b-60d2-477f-a441-246a51db23fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:16.692791 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e888580b-60d2-477f-a441-246a51db23fd admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:16.693473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888580b-60d2-477f-a441-246a51db23fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:16.695489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e888580b-60d2-477f-a441-246a51db23fd admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:16.728992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1303/2586] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:16 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:16.733280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4421eaa-65c3-4533-bb31-3cc52293189e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:16.743988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4421eaa-65c3-4533-bb31-3cc52293189e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:16.808770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344899a-969d-4e5b-b0e2-71880e80e6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:16.809393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344899a-969d-4e5b-b0e2-71880e80e6ea admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:16.809681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344899a-969d-4e5b-b0e2-71880e80e6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:16.809952 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2344899a-969d-4e5b-b0e2-71880e80e6ea admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:16.810587 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344899a-969d-4e5b-b0e2-71880e80e6ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:16.812588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2344899a-969d-4e5b-b0e2-71880e80e6ea admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:16.821980 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:16.837068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1284/2587] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:16 2022] POST /identity/v3/users => generated 294 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:16.841161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888580b-60d2-477f-a441-246a51db23fd admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:16.853263 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e888580b-60d2-477f-a441-246a51db23fd admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:16.858520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a524dab-eef4-4dea-8505-495cc0d18381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:16.859168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a524dab-eef4-4dea-8505-495cc0d18381 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:16.859446 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a524dab-eef4-4dea-8505-495cc0d18381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:16.859714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a524dab-eef4-4dea-8505-495cc0d18381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:16.860395 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a524dab-eef4-4dea-8505-495cc0d18381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:16.862024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a524dab-eef4-4dea-8505-495cc0d18381 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:16.872946 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1304/2588] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:16.877063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344899a-969d-4e5b-b0e2-71880e80e6ea admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:16.887792 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2344899a-969d-4e5b-b0e2-71880e80e6ea admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:16.892808 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6438c8-1478-451e-9faf-6c867a5be7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:16.893404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6438c8-1478-451e-9faf-6c867a5be7bb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:16.893683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6438c8-1478-451e-9faf-6c867a5be7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:16.893958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6438c8-1478-451e-9faf-6c867a5be7bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:16.894618 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6438c8-1478-451e-9faf-6c867a5be7bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:16.896461 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6438c8-1478-451e-9faf-6c867a5be7bb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:16.908467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1285/2589] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:16.913047 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a524dab-eef4-4dea-8505-495cc0d18381 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:16.923175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a524dab-eef4-4dea-8505-495cc0d18381 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:16.928558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de879cd-5854-4be8-a4f8-2f393624acd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:16.929216 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de879cd-5854-4be8-a4f8-2f393624acd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:16.929497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de879cd-5854-4be8-a4f8-2f393624acd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:16.929767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de879cd-5854-4be8-a4f8-2f393624acd1 admin admin] PATH_INFO: `/v3/projects/5c10f6567f9246dc8f0e6ac0541008f7/users/ecc1521ad63142a293f621df34826db3/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:16.944673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de879cd-5854-4be8-a4f8-2f393624acd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c10f6567f9246dc8f0e6ac0541008f7, user_id=ecc1521ad63142a293f621df34826db3, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:16.947330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de879cd-5854-4be8-a4f8-2f393624acd1 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:16.963539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1305/2590] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:16 2022] PUT /identity/v3/projects/5c10f6567f9246dc8f0e6ac0541008f7/users/ecc1521ad63142a293f621df34826db3/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:16.974679 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40305030-9cb2-4488-804d-e555aee8c218 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:16.976343 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40305030-9cb2-4488-804d-e555aee8c218 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:16.976635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40305030-9cb2-4488-804d-e555aee8c218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:17.006744 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-40305030-9cb2-4488-804d-e555aee8c218 None None] MFA Rules not processed for user `ecc1521ad63142a293f621df34826db3`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:17.008052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-40305030-9cb2-4488-804d-e555aee8c218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:17.086147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1286/2591] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:16 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:17.091071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de879cd-5854-4be8-a4f8-2f393624acd1 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:17.164483 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de879cd-5854-4be8-a4f8-2f393624acd1 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:17.170512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71aafb-b772-4735-81a0-3ad62a23eee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:17.171148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71aafb-b772-4735-81a0-3ad62a23eee8 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:17.171434 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71aafb-b772-4735-81a0-3ad62a23eee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:17.171701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d71aafb-b772-4735-81a0-3ad62a23eee8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:17.172317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71aafb-b772-4735-81a0-3ad62a23eee8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:17.174266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d71aafb-b772-4735-81a0-3ad62a23eee8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:17.203165 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1306/2592] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:17 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:17.206967 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40305030-9cb2-4488-804d-e555aee8c218 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:17.218813 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40305030-9cb2-4488-804d-e555aee8c218 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:17.275812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e292c7-a9e8-4c0b-81fe-404293a4eccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:17.276429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e292c7-a9e8-4c0b-81fe-404293a4eccd admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:17.276704 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e292c7-a9e8-4c0b-81fe-404293a4eccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:17.276970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e292c7-a9e8-4c0b-81fe-404293a4eccd admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:17.277591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e292c7-a9e8-4c0b-81fe-404293a4eccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:17.279631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e292c7-a9e8-4c0b-81fe-404293a4eccd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:17.306633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1287/2593] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:17 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:17.310476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71aafb-b772-4735-81a0-3ad62a23eee8 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:17.321576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d71aafb-b772-4735-81a0-3ad62a23eee8 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:17.327447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4399f-4638-4b4d-a395-b385d06bd725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:17.328159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4399f-4638-4b4d-a395-b385d06bd725 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:17.328516 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4399f-4638-4b4d-a395-b385d06bd725 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:17.328830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d4399f-4638-4b4d-a395-b385d06bd725 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:17.329477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4399f-4638-4b4d-a395-b385d06bd725 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:17.331174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d4399f-4638-4b4d-a395-b385d06bd725 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:17.343421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1307/2594] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:17.348136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e292c7-a9e8-4c0b-81fe-404293a4eccd admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:17.358295 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e292c7-a9e8-4c0b-81fe-404293a4eccd admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:17.362882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43864cd6-d1e7-4c28-a4b4-ead206439d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:17.363621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864cd6-d1e7-4c28-a4b4-ead206439d0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:17.363969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864cd6-d1e7-4c28-a4b4-ead206439d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:17.364235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864cd6-d1e7-4c28-a4b4-ead206439d0c admin admin] PATH_INFO: `/v3/projects/caf48028b8ad47409e2cabdd46d12785/users/57806d8d540447edb8cd4c887d362264/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:17.379364 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43864cd6-d1e7-4c28-a4b4-ead206439d0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf48028b8ad47409e2cabdd46d12785, user_id=57806d8d540447edb8cd4c887d362264, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:17.382229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43864cd6-d1e7-4c28-a4b4-ead206439d0c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:17.397105 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1288/2595] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:17 2022] PUT /identity/v3/projects/caf48028b8ad47409e2cabdd46d12785/users/57806d8d540447edb8cd4c887d362264/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:17.401276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4399f-4638-4b4d-a395-b385d06bd725 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:17.412247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d4399f-4638-4b4d-a395-b385d06bd725 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:17.425875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:17.479350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b024813-05ef-49cd-bf9d-ec69f62762ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:17.479995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024813-05ef-49cd-bf9d-ec69f62762ea admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:17.480271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024813-05ef-49cd-bf9d-ec69f62762ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:17.480542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b024813-05ef-49cd-bf9d-ec69f62762ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:17.481312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b024813-05ef-49cd-bf9d-ec69f62762ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:17.482956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b024813-05ef-49cd-bf9d-ec69f62762ea admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:17.495013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1308/2596] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:17 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:17.499713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43864cd6-d1e7-4c28-a4b4-ead206439d0c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:17.513746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43864cd6-d1e7-4c28-a4b4-ead206439d0c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:17.519255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e9c0d-bf88-4c6a-8c41-5f06516b97fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:17.519988 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9c0d-bf88-4c6a-8c41-5f06516b97fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:17.520335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9c0d-bf88-4c6a-8c41-5f06516b97fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:17.520674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e9c0d-bf88-4c6a-8c41-5f06516b97fa admin admin] PATH_INFO: `/v3/projects/caf48028b8ad47409e2cabdd46d12785/users/57806d8d540447edb8cd4c887d362264/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:17.523040 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e9c0d-bf88-4c6a-8c41-5f06516b97fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf48028b8ad47409e2cabdd46d12785, user_id=57806d8d540447edb8cd4c887d362264, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:17.525878 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85e9c0d-bf88-4c6a-8c41-5f06516b97fa admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:17.541375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1289/2597] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:17 2022] PUT /identity/v3/projects/caf48028b8ad47409e2cabdd46d12785/users/57806d8d540447edb8cd4c887d362264/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:17.547306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6606af-635f-47e7-bc40-a823493faa40 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:17.547671 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6606af-635f-47e7-bc40-a823493faa40 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:17.548105 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6606af-635f-47e7-bc40-a823493faa40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:17.578272 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ed6606af-635f-47e7-bc40-a823493faa40 None None] MFA Rules not processed for user `57806d8d540447edb8cd4c887d362264`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:17.579540 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ed6606af-635f-47e7-bc40-a823493faa40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:17.660902 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1309/2598] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:17.672261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e9c0d-bf88-4c6a-8c41-5f06516b97fa admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:17.674219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-f85e9c0d-bf88-4c6a-8c41-5f06516b97fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:17.703698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:17.736567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e9c0d-bf88-4c6a-8c41-5f06516b97fa admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:17.740333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25504c0-150e-479e-a045-e82634b93ffc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:17.741087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25504c0-150e-479e-a045-e82634b93ffc service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:17.741362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25504c0-150e-479e-a045-e82634b93ffc service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:17.741629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25504c0-150e-479e-a045-e82634b93ffc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:17.751174 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25504c0-150e-479e-a045-e82634b93ffc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:17.753388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25504c0-150e-479e-a045-e82634b93ffc service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:17.765116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1290/2599] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:17 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:18.392056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6606af-635f-47e7-bc40-a823493faa40 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:18.457772 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6606af-635f-47e7-bc40-a823493faa40 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:18.462693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:18.463352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:18.463623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:18.463888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] PATH_INFO: `/v3/users/ecc1521ad63142a293f621df34826db3` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:18.465027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc1521ad63142a293f621df34826db3)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:18.466974 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:18.511198 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:18.517497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc1521ad63142a293f621df34826db3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:18.530887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc1521ad63142a293f621df34826db3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:18.540220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc1521ad63142a293f621df34826db3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:18.548641 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc1521ad63142a293f621df34826db3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:18.549328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc1521ad63142a293f621df34826db3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:18.555609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1310/2600] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:18 2022] DELETE /identity/v3/users/ecc1521ad63142a293f621df34826db3 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:18.560281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437988dc-14ca-4eda-8cb9-a557a655a678 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:18.560773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437988dc-14ca-4eda-8cb9-a557a655a678 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:18.560871 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437988dc-14ca-4eda-8cb9-a557a655a678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:18.580820 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-437988dc-14ca-4eda-8cb9-a557a655a678 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:18.582048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-437988dc-14ca-4eda-8cb9-a557a655a678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:18.645524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1291/2601] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:18.656650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:18.658457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:18.723758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44689e0f-20f9-4f08-8ecd-c5b65b5eb38a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:18.728388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55454bf-b0d1-4bd7-afd4-467039f82709 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:18.729018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55454bf-b0d1-4bd7-afd4-467039f82709 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:18.729441 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55454bf-b0d1-4bd7-afd4-467039f82709 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:18.729716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55454bf-b0d1-4bd7-afd4-467039f82709 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:18.739678 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55454bf-b0d1-4bd7-afd4-467039f82709 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:18.741242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55454bf-b0d1-4bd7-afd4-467039f82709 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:18.752461 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1311/2602] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:19.048111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437988dc-14ca-4eda-8cb9-a557a655a678 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:19.049920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-437988dc-14ca-4eda-8cb9-a557a655a678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:19.064638 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437988dc-14ca-4eda-8cb9-a557a655a678 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:19.070646 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:19.071537 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:19.072018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:19.072477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] PATH_INFO: `/v3/projects/5c10f6567f9246dc8f0e6ac0541008f7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:19.074094 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c10f6567f9246dc8f0e6ac0541008f7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:19.076277 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:19.136666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c10f6567f9246dc8f0e6ac0541008f7', 'request_id': 'req-afce6633-24e9-43fd-bf17-c11241de93b5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.148725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c10f6567f9246dc8f0e6ac0541008f7', 'request_id': 'req-afce6633-24e9-43fd-bf17-c11241de93b5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.158129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c10f6567f9246dc8f0e6ac0541008f7', 'request_id': 'req-afce6633-24e9-43fd-bf17-c11241de93b5'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.170466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] The token cache is being invalidate because project 5c10f6567f9246dc8f0e6ac0541008f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:19.170756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.171641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.173345 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1292/2603] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:19 2022] DELETE /identity/v3/projects/5c10f6567f9246dc8f0e6ac0541008f7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:19.178104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55454bf-b0d1-4bd7-afd4-467039f82709 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:19.189158 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55454bf-b0d1-4bd7-afd4-467039f82709 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:19.256515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:19.257154 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:19.257409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:19.257734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] PATH_INFO: `/v3/users/57806d8d540447edb8cd4c887d362264` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:19.259034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=57806d8d540447edb8cd4c887d362264)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:19.260985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:19.315037 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '57806d8d540447edb8cd4c887d362264'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.325930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:19.327118 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '57806d8d540447edb8cd4c887d362264'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.337889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '57806d8d540447edb8cd4c887d362264'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.345201 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '57806d8d540447edb8cd4c887d362264'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.345906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '57806d8d540447edb8cd4c887d362264'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.352359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1312/2604] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:19 2022] DELETE /identity/v3/users/57806d8d540447edb8cd4c887d362264 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:19.649628 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:19.651457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:19.667932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afce6633-24e9-43fd-bf17-c11241de93b5 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:19.723958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:19.741450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:19.742169 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:19.742522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:19.742928 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] PATH_INFO: `/v3/projects/caf48028b8ad47409e2cabdd46d12785` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:19.744385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf48028b8ad47409e2cabdd46d12785)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:19.746307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:19.801504 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf48028b8ad47409e2cabdd46d12785', 'request_id': 'req-c557b946-c053-4c6b-88be-0d9913febe81'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.812092 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf48028b8ad47409e2cabdd46d12785', 'request_id': 'req-c557b946-c053-4c6b-88be-0d9913febe81'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.819834 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf48028b8ad47409e2cabdd46d12785', 'request_id': 'req-c557b946-c053-4c6b-88be-0d9913febe81'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.820359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:19.821802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:19.836337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] The token cache is being invalidate because project caf48028b8ad47409e2cabdd46d12785 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:19.836633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.837308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c557b946-c053-4c6b-88be-0d9913febe81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:19.839310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1293/2605] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:19 2022] DELETE /identity/v3/projects/caf48028b8ad47409e2cabdd46d12785 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:19.843798 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902757-a66e-47e0-95a3-4004e73c0fe3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:19.844093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902757-a66e-47e0-95a3-4004e73c0fe3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:19.844379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec902757-a66e-47e0-95a3-4004e73c0fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:19.869818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ec902757-a66e-47e0-95a3-4004e73c0fe3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:19.871263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ec902757-a66e-47e0-95a3-4004e73c0fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:19.888455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cfcdcc-12a3-4b96-890d-bbdca32ce320 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:19.964202 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73393829-44c5-4a2b-a02e-d22b9ced7b73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:19.964864 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393829-44c5-4a2b-a02e-d22b9ced7b73 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:19.965147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393829-44c5-4a2b-a02e-d22b9ced7b73 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:19.965422 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73393829-44c5-4a2b-a02e-d22b9ced7b73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:19.967309 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-73393829-44c5-4a2b-a02e-d22b9ced7b73 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:20.034269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73393829-44c5-4a2b-a02e-d22b9ced7b73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:20.035956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73393829-44c5-4a2b-a02e-d22b9ced7b73 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:20.045914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1313/2606] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:20.061839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1294/2607] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:20.070081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be949-4bbd-4e88-9f5f-52c0c1625b9a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.070449 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be949-4bbd-4e88-9f5f-52c0c1625b9a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.070686 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541be949-4bbd-4e88-9f5f-52c0c1625b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.090634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-541be949-4bbd-4e88-9f5f-52c0c1625b9a None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:20.091922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-541be949-4bbd-4e88-9f5f-52c0c1625b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:20.100155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1314/2608] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:20.104866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902757-a66e-47e0-95a3-4004e73c0fe3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:20.114804 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec902757-a66e-47e0-95a3-4004e73c0fe3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:20.120629 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e578a7-f96e-49d9-bc6e-d177e87f932a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:20.121429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e578a7-f96e-49d9-bc6e-d177e87f932a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.121704 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e578a7-f96e-49d9-bc6e-d177e87f932a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.122008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e578a7-f96e-49d9-bc6e-d177e87f932a admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.122938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e578a7-f96e-49d9-bc6e-d177e87f932a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:20.123254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e578a7-f96e-49d9-bc6e-d177e87f932a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:20.124853 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e578a7-f96e-49d9-bc6e-d177e87f932a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:20.140049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1295/2609] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:14:20.145306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be949-4bbd-4e88-9f5f-52c0c1625b9a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:20.157500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541be949-4bbd-4e88-9f5f-52c0c1625b9a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:20.162584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676d2dc-c70b-4240-9467-cf768f3f41d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:20.163237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676d2dc-c70b-4240-9467-cf768f3f41d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.163513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676d2dc-c70b-4240-9467-cf768f3f41d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.163963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a676d2dc-c70b-4240-9467-cf768f3f41d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.164605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676d2dc-c70b-4240-9467-cf768f3f41d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:20.166528 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a676d2dc-c70b-4240-9467-cf768f3f41d3 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:20.203045 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1315/2610] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:20 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:20.204569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e578a7-f96e-49d9-bc6e-d177e87f932a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:20.215306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e578a7-f96e-49d9-bc6e-d177e87f932a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:20.296543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060db93-158a-49c4-9b9d-900f885ba402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:20.297310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060db93-158a-49c4-9b9d-900f885ba402 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.297686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060db93-158a-49c4-9b9d-900f885ba402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.298287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4060db93-158a-49c4-9b9d-900f885ba402 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.298968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060db93-158a-49c4-9b9d-900f885ba402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:20.301008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4060db93-158a-49c4-9b9d-900f885ba402 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:20.312920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:20.329113 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1296/2611] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:20 2022] POST /identity/v3/users => generated 293 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:20.334585 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676d2dc-c70b-4240-9467-cf768f3f41d3 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:20.352800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a676d2dc-c70b-4240-9467-cf768f3f41d3 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:20.358965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406de07-4151-4fdf-bf04-be91e635e261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:20.359960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406de07-4151-4fdf-bf04-be91e635e261 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.360634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406de07-4151-4fdf-bf04-be91e635e261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.360938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b406de07-4151-4fdf-bf04-be91e635e261 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.361589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406de07-4151-4fdf-bf04-be91e635e261 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:20.363716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b406de07-4151-4fdf-bf04-be91e635e261 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:20.374707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1316/2612] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:20.378583 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060db93-158a-49c4-9b9d-900f885ba402 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:20.389736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4060db93-158a-49c4-9b9d-900f885ba402 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:20.395032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8817b377-c559-46ae-8ea3-17f5f259e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:20.395904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b377-c559-46ae-8ea3-17f5f259e2af admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.396176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b377-c559-46ae-8ea3-17f5f259e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.396496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8817b377-c559-46ae-8ea3-17f5f259e2af admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.397223 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b377-c559-46ae-8ea3-17f5f259e2af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:20.398917 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8817b377-c559-46ae-8ea3-17f5f259e2af admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:20.409772 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1297/2613] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:20.414720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406de07-4151-4fdf-bf04-be91e635e261 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:20.424845 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b406de07-4151-4fdf-bf04-be91e635e261 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:20.431353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f27853-4022-4363-a362-3f4c97affba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:20.432091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f27853-4022-4363-a362-3f4c97affba5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.432373 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f27853-4022-4363-a362-3f4c97affba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.432647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f27853-4022-4363-a362-3f4c97affba5 admin admin] PATH_INFO: `/v3/projects/e5637ff6a9e744d09156b9ef3d4f66da/users/8413fd57fc7341188c3753b2f5775d71/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.442005 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:20.451018 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f27853-4022-4363-a362-3f4c97affba5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5637ff6a9e744d09156b9ef3d4f66da, user_id=8413fd57fc7341188c3753b2f5775d71, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:20.454013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f27853-4022-4363-a362-3f4c97affba5 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:20.471595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1317/2614] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:20 2022] PUT /identity/v3/projects/e5637ff6a9e744d09156b9ef3d4f66da/users/8413fd57fc7341188c3753b2f5775d71/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:20.483180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee04cfa-2d17-4e47-a9bb-b85cecfaf65f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.483543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee04cfa-2d17-4e47-a9bb-b85cecfaf65f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.483984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee04cfa-2d17-4e47-a9bb-b85cecfaf65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.528333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8ee04cfa-2d17-4e47-a9bb-b85cecfaf65f None None] MFA Rules not processed for user `8413fd57fc7341188c3753b2f5775d71`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:20.529559 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8ee04cfa-2d17-4e47-a9bb-b85cecfaf65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:20.600776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1298/2615] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:20.612227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f27853-4022-4363-a362-3f4c97affba5 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:20.614009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-13f27853-4022-4363-a362-3f4c97affba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:20.672822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f27853-4022-4363-a362-3f4c97affba5 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:20.676730 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b1dfd-c79c-4b26-8b69-76295c7a208b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:20.677336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b1dfd-c79c-4b26-8b69-76295c7a208b service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.677652 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b1dfd-c79c-4b26-8b69-76295c7a208b service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.677938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b1dfd-c79c-4b26-8b69-76295c7a208b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.686448 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b1dfd-c79c-4b26-8b69-76295c7a208b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:20.687936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b1dfd-c79c-4b26-8b69-76295c7a208b service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:20.697633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1318/2616] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:14:20.718406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee04cfa-2d17-4e47-a9bb-b85cecfaf65f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:20.794398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee04cfa-2d17-4e47-a9bb-b85cecfaf65f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:20.799304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:20.799930 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.800203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.800482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] PATH_INFO: `/v3/users/8413fd57fc7341188c3753b2f5775d71` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.801641 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] RBAC: Authorizing `identity:delete_user(user_id=8413fd57fc7341188c3753b2f5775d71)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:20.803740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:20.854863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8413fd57fc7341188c3753b2f5775d71'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:20.855463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8413fd57fc7341188c3753b2f5775d71'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:20.856064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8413fd57fc7341188c3753b2f5775d71'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:20.868644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8413fd57fc7341188c3753b2f5775d71'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:20.878472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8413fd57fc7341188c3753b2f5775d71'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:20.884228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:20.894251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1299/2617] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:20 2022] DELETE /identity/v3/users/8413fd57fc7341188c3753b2f5775d71 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:20.899595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb75d5-d678-44b0-b690-ece3a37209dd None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:20.900094 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb75d5-d678-44b0-b690-ece3a37209dd None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:20.900193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcb75d5-d678-44b0-b690-ece3a37209dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:20.919688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-ffcb75d5-d678-44b0-b690-ece3a37209dd None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:20.920901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ffcb75d5-d678-44b0-b690-ece3a37209dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:20.988317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1319/2618] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:20.999000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:21.000633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:21.070142 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255eac-f169-4a8b-99af-ac8a5d98147c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:21.074071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b20e4-7a55-4224-aac8-fbf389e48cf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:21.074684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b20e4-7a55-4224-aac8-fbf389e48cf4 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:21.075125 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b20e4-7a55-4224-aac8-fbf389e48cf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:21.075238 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b20e4-7a55-4224-aac8-fbf389e48cf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:21.085229 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b20e4-7a55-4224-aac8-fbf389e48cf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:21.086793 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b20e4-7a55-4224-aac8-fbf389e48cf4 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:21.096831 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1300/2619] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:21.401736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb75d5-d678-44b0-b690-ece3a37209dd None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:21.403328 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ffcb75d5-d678-44b0-b690-ece3a37209dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:21.417456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcb75d5-d678-44b0-b690-ece3a37209dd None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:21.423800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:21.424482 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:21.424756 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:21.425022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] PATH_INFO: `/v3/projects/e5637ff6a9e744d09156b9ef3d4f66da` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:21.426293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5637ff6a9e744d09156b9ef3d4f66da)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:21.428864 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:21.477182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5637ff6a9e744d09156b9ef3d4f66da', 'request_id': 'req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:21.482662 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5637ff6a9e744d09156b9ef3d4f66da', 'request_id': 'req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:21.491785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5637ff6a9e744d09156b9ef3d4f66da', 'request_id': 'req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:21.502991 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] The token cache is being invalidate because project e5637ff6a9e744d09156b9ef3d4f66da was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:21.503278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:21.504242 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c7d822e7-92c5-4cbb-b9ef-79ec6ee12f69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:21.505513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1320/2620] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:21 2022] DELETE /identity/v3/projects/e5637ff6a9e744d09156b9ef3d4f66da => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:21.510744 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55ac0-bc10-4207-b20d-7bd05411f5ee None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:21.511067 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55ac0-bc10-4207-b20d-7bd05411f5ee None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:21.511342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a55ac0-bc10-4207-b20d-7bd05411f5ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:21.531355 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-c2a55ac0-bc10-4207-b20d-7bd05411f5ee None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:21.532591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c2a55ac0-bc10-4207-b20d-7bd05411f5ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:21.599729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1301/2621] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:21.608817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a101-bd81-4e4b-b64f-45d7c0e14dad None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:21.609097 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a101-bd81-4e4b-b64f-45d7c0e14dad None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:21.609369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6134a101-bd81-4e4b-b64f-45d7c0e14dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:21.630262 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-6134a101-bd81-4e4b-b64f-45d7c0e14dad None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:21.631844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6134a101-bd81-4e4b-b64f-45d7c0e14dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:21.640317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1321/2622] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:21.645155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a55ac0-bc10-4207-b20d-7bd05411f5ee None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:21.657548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a55ac0-bc10-4207-b20d-7bd05411f5ee None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:21.667496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc6e17-7025-4d1c-9eb1-ef6e343fc6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:21.668564 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc6e17-7025-4d1c-9eb1-ef6e343fc6d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:21.669101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc6e17-7025-4d1c-9eb1-ef6e343fc6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:21.669498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cc6e17-7025-4d1c-9eb1-ef6e343fc6d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:21.670450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc6e17-7025-4d1c-9eb1-ef6e343fc6d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:21.670762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc6e17-7025-4d1c-9eb1-ef6e343fc6d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:21.672400 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cc6e17-7025-4d1c-9eb1-ef6e343fc6d6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:21.685002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1302/2623] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:14:21.689967 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a101-bd81-4e4b-b64f-45d7c0e14dad None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:21.704117 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6134a101-bd81-4e4b-b64f-45d7c0e14dad None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:21.711378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb5a01-dda5-4b02-a480-2b5f3244ba97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:21.712007 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb5a01-dda5-4b02-a480-2b5f3244ba97 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:21.712318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb5a01-dda5-4b02-a480-2b5f3244ba97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:21.712591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb5a01-dda5-4b02-a480-2b5f3244ba97 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:21.713212 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb5a01-dda5-4b02-a480-2b5f3244ba97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:21.715184 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb5a01-dda5-4b02-a480-2b5f3244ba97 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:21.719904 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:21.747576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1322/2624] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:21 2022] POST /identity/v3/projects => generated 361 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:21.751969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc6e17-7025-4d1c-9eb1-ef6e343fc6d6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:21.763254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cc6e17-7025-4d1c-9eb1-ef6e343fc6d6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:21.821577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12984397-511b-4980-8fc0-94b00e207237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:21.822183 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984397-511b-4980-8fc0-94b00e207237 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:21.822456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984397-511b-4980-8fc0-94b00e207237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:21.822727 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12984397-511b-4980-8fc0-94b00e207237 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:21.823376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12984397-511b-4980-8fc0-94b00e207237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:21.825302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12984397-511b-4980-8fc0-94b00e207237 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:21.850630 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1303/2625] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:21 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:21.855082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb5a01-dda5-4b02-a480-2b5f3244ba97 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:21.865706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb5a01-dda5-4b02-a480-2b5f3244ba97 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:21.871039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3e906-dd51-4051-bbcf-3d33698e57be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:21.871653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3e906-dd51-4051-bbcf-3d33698e57be admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:21.871931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3e906-dd51-4051-bbcf-3d33698e57be admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:21.872200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3e906-dd51-4051-bbcf-3d33698e57be admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:21.872875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3e906-dd51-4051-bbcf-3d33698e57be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:21.874537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3e906-dd51-4051-bbcf-3d33698e57be admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:21.885456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1323/2626] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:21.889674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12984397-511b-4980-8fc0-94b00e207237 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:21.901202 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12984397-511b-4980-8fc0-94b00e207237 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:21.907241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da49e3db-ceee-48fc-ad82-ba97e3849de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:21.907843 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49e3db-ceee-48fc-ad82-ba97e3849de0 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:21.908117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49e3db-ceee-48fc-ad82-ba97e3849de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:21.908382 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da49e3db-ceee-48fc-ad82-ba97e3849de0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:21.909031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49e3db-ceee-48fc-ad82-ba97e3849de0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:21.910643 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da49e3db-ceee-48fc-ad82-ba97e3849de0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:21.921264 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1304/2627] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:21.925602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3e906-dd51-4051-bbcf-3d33698e57be admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:21.936537 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3e906-dd51-4051-bbcf-3d33698e57be admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:21.942443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04514f16-5608-41eb-b724-f7b44d3237fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:21.943140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04514f16-5608-41eb-b724-f7b44d3237fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:21.943635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04514f16-5608-41eb-b724-f7b44d3237fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:21.943960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04514f16-5608-41eb-b724-f7b44d3237fc admin admin] PATH_INFO: `/v3/projects/4b5f7cbbdbef40cf931152c428c4fea9/users/6863eccd054a404ca673fade30091fa2/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:21.959802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04514f16-5608-41eb-b724-f7b44d3237fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5f7cbbdbef40cf931152c428c4fea9, user_id=6863eccd054a404ca673fade30091fa2, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:21.962483 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04514f16-5608-41eb-b724-f7b44d3237fc admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:21.978806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1324/2628] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:21 2022] PUT /identity/v3/projects/4b5f7cbbdbef40cf931152c428c4fea9/users/6863eccd054a404ca673fade30091fa2/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:22.045349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c84a-11c5-4a64-bd42-c432f62f31e3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:22.045588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c84a-11c5-4a64-bd42-c432f62f31e3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:22.045886 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e04c84a-11c5-4a64-bd42-c432f62f31e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:22.054271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:22.078413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-4e04c84a-11c5-4a64-bd42-c432f62f31e3 None None] MFA Rules not processed for user `6863eccd054a404ca673fade30091fa2`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:22.079654 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-4e04c84a-11c5-4a64-bd42-c432f62f31e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:22.146946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1305/2629] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:22.181049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04514f16-5608-41eb-b724-f7b44d3237fc admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:22.183248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-04514f16-5608-41eb-b724-f7b44d3237fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:22.245844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04514f16-5608-41eb-b724-f7b44d3237fc admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:22.249736 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e881095-4bf0-4d49-ba7f-1f65c1ff9495 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:22.250352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e881095-4bf0-4d49-ba7f-1f65c1ff9495 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:22.250627 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e881095-4bf0-4d49-ba7f-1f65c1ff9495 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:22.251561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e881095-4bf0-4d49-ba7f-1f65c1ff9495 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:22.260692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e881095-4bf0-4d49-ba7f-1f65c1ff9495 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:22.262128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e881095-4bf0-4d49-ba7f-1f65c1ff9495 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:22.271922 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1325/2630] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:22.287282 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04c84a-11c5-4a64-bd42-c432f62f31e3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:22.364809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e04c84a-11c5-4a64-bd42-c432f62f31e3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:22.370275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:22.370989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:22.371266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:22.371526 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] PATH_INFO: `/v3/users/6863eccd054a404ca673fade30091fa2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:22.372711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6863eccd054a404ca673fade30091fa2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:22.374625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:22.425903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6863eccd054a404ca673fade30091fa2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:22.426471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6863eccd054a404ca673fade30091fa2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:22.427086 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6863eccd054a404ca673fade30091fa2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:22.438640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6863eccd054a404ca673fade30091fa2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:22.448055 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6863eccd054a404ca673fade30091fa2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:22.461044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1306/2631] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:22 2022] DELETE /identity/v3/users/6863eccd054a404ca673fade30091fa2 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:22.465700 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8238-def9-4cea-95e9-cc44181faddb None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:22.466020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8238-def9-4cea-95e9-cc44181faddb None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:22.466298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8238-def9-4cea-95e9-cc44181faddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:22.486077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-c21a8238-def9-4cea-95e9-cc44181faddb None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:22.487334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c21a8238-def9-4cea-95e9-cc44181faddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:22.549002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1326/2632] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:22.559267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:22.560976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:22.576087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:22.622082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b0f08-3d2c-4e75-8d63-e9c692de987e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:22.626083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ee9018-c8d4-459a-9f0d-93008f15b88e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:22.626687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee9018-c8d4-459a-9f0d-93008f15b88e service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:22.626987 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee9018-c8d4-459a-9f0d-93008f15b88e service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:22.627255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ee9018-c8d4-459a-9f0d-93008f15b88e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:22.636591 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee9018-c8d4-459a-9f0d-93008f15b88e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:22.638022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ee9018-c8d4-459a-9f0d-93008f15b88e service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:22.648030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1307/2633] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:22.933846 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a8238-def9-4cea-95e9-cc44181faddb None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:22.935507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c21a8238-def9-4cea-95e9-cc44181faddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:22.948296 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a8238-def9-4cea-95e9-cc44181faddb None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:22.953648 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:22.954220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:22.954502 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:22.954732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] PATH_INFO: `/v3/projects/4b5f7cbbdbef40cf931152c428c4fea9` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:22.956217 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5f7cbbdbef40cf931152c428c4fea9)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:22.958107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:23.007390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:23.008602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5f7cbbdbef40cf931152c428c4fea9', 'request_id': 'req-03d8526c-efe0-45e2-8b21-ba673452945d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:23.014907 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5f7cbbdbef40cf931152c428c4fea9', 'request_id': 'req-03d8526c-efe0-45e2-8b21-ba673452945d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:23.024354 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5f7cbbdbef40cf931152c428c4fea9', 'request_id': 'req-03d8526c-efe0-45e2-8b21-ba673452945d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:23.035823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] The token cache is being invalidate because project 4b5f7cbbdbef40cf931152c428c4fea9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:23.036109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:23.036829 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-03d8526c-efe0-45e2-8b21-ba673452945d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:23.038469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1327/2634] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:22 2022] DELETE /identity/v3/projects/4b5f7cbbdbef40cf931152c428c4fea9 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:23.043551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e060fb1-0f0d-46e1-ba1c-daa834acb141 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:23.044103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e060fb1-0f0d-46e1-ba1c-daa834acb141 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:23.044103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e060fb1-0f0d-46e1-ba1c-daa834acb141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:23.064441 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-3e060fb1-0f0d-46e1-ba1c-daa834acb141 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:23.065656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3e060fb1-0f0d-46e1-ba1c-daa834acb141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:23.129477 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1308/2635] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:23.140639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28873624-3ba9-4aa7-b1f7-9915549aafd7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:23.141276 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28873624-3ba9-4aa7-b1f7-9915549aafd7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:23.141551 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28873624-3ba9-4aa7-b1f7-9915549aafd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:23.163179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-28873624-3ba9-4aa7-b1f7-9915549aafd7 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:23.164908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-28873624-3ba9-4aa7-b1f7-9915549aafd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:23.173523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1328/2636] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:23.178007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e060fb1-0f0d-46e1-ba1c-daa834acb141 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:23.188832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e060fb1-0f0d-46e1-ba1c-daa834acb141 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:23.194351 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9a4bc-3c9d-4d2d-8850-618f7d18f88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:23.195535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a4bc-3c9d-4d2d-8850-618f7d18f88a admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:23.195819 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a4bc-3c9d-4d2d-8850-618f7d18f88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:23.196089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9a4bc-3c9d-4d2d-8850-618f7d18f88a admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:23.196741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9a4bc-3c9d-4d2d-8850-618f7d18f88a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:23.197030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9a4bc-3c9d-4d2d-8850-618f7d18f88a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:23.198662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9a4bc-3c9d-4d2d-8850-618f7d18f88a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:23.210865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1309/2637] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:14:23.215312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28873624-3ba9-4aa7-b1f7-9915549aafd7 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:23.225257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28873624-3ba9-4aa7-b1f7-9915549aafd7 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:23.231939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac20b1-b471-412c-a4bf-0004e50cc28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:23.232543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac20b1-b471-412c-a4bf-0004e50cc28c admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:23.232816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac20b1-b471-412c-a4bf-0004e50cc28c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:23.233081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac20b1-b471-412c-a4bf-0004e50cc28c admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:23.233801 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac20b1-b471-412c-a4bf-0004e50cc28c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:23.235751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac20b1-b471-412c-a4bf-0004e50cc28c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:23.272648 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1329/2638] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:23 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:23.273951 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9a4bc-3c9d-4d2d-8850-618f7d18f88a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:23.284299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9a4bc-3c9d-4d2d-8850-618f7d18f88a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:23.344548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720c7ff-ca63-4e9a-b2f3-e4a960ea3a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:23.345278 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720c7ff-ca63-4e9a-b2f3-e4a960ea3a4b admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:23.345553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720c7ff-ca63-4e9a-b2f3-e4a960ea3a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:23.345834 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a720c7ff-ca63-4e9a-b2f3-e4a960ea3a4b admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:23.346454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720c7ff-ca63-4e9a-b2f3-e4a960ea3a4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:23.348416 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a720c7ff-ca63-4e9a-b2f3-e4a960ea3a4b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:23.378963 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1310/2639] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:23 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:23.382085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac20b1-b471-412c-a4bf-0004e50cc28c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:23.393065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac20b1-b471-412c-a4bf-0004e50cc28c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:23.398650 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760956f-ecb7-4d29-83e3-a9d83067bf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:23.399334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760956f-ecb7-4d29-83e3-a9d83067bf16 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:23.399605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760956f-ecb7-4d29-83e3-a9d83067bf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:23.399867 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d760956f-ecb7-4d29-83e3-a9d83067bf16 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:23.400500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760956f-ecb7-4d29-83e3-a9d83067bf16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:23.402250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d760956f-ecb7-4d29-83e3-a9d83067bf16 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:23.412077 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1330/2640] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:23.416308 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720c7ff-ca63-4e9a-b2f3-e4a960ea3a4b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:23.427220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a720c7ff-ca63-4e9a-b2f3-e4a960ea3a4b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:23.433061 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4325d4a6-74db-4389-bd98-ab4053ff5037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:23.433590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325d4a6-74db-4389-bd98-ab4053ff5037 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:23.433869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325d4a6-74db-4389-bd98-ab4053ff5037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:23.434145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4325d4a6-74db-4389-bd98-ab4053ff5037 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:23.434795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325d4a6-74db-4389-bd98-ab4053ff5037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:23.436404 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4325d4a6-74db-4389-bd98-ab4053ff5037 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:23.447846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1311/2641] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:23.452450 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760956f-ecb7-4d29-83e3-a9d83067bf16 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:23.467858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d760956f-ecb7-4d29-83e3-a9d83067bf16 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:23.476711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d4408-4fea-4160-b595-d8d03906c5b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:23.477367 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d4408-4fea-4160-b595-d8d03906c5b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:23.477628 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d4408-4fea-4160-b595-d8d03906c5b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:23.477890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d4408-4fea-4160-b595-d8d03906c5b4 admin admin] PATH_INFO: `/v3/projects/7a27b790b1bc417bafecb58cee816634/users/24205e0903614fe2a6cdfd133667b5ef/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:23.494024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d4408-4fea-4160-b595-d8d03906c5b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a27b790b1bc417bafecb58cee816634, user_id=24205e0903614fe2a6cdfd133667b5ef, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:23.496773 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d4408-4fea-4160-b595-d8d03906c5b4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:23.513155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1331/2642] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:23 2022] PUT /identity/v3/projects/7a27b790b1bc417bafecb58cee816634/users/24205e0903614fe2a6cdfd133667b5ef/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:23.526002 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09e1ba-aa8e-455d-87f3-ef4c5cf16057 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:23.526286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09e1ba-aa8e-455d-87f3-ef4c5cf16057 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:23.526575 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc09e1ba-aa8e-455d-87f3-ef4c5cf16057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:23.556613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dc09e1ba-aa8e-455d-87f3-ef4c5cf16057 None None] MFA Rules not processed for user `24205e0903614fe2a6cdfd133667b5ef`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:23.557824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dc09e1ba-aa8e-455d-87f3-ef4c5cf16057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:23.567807 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:23.628998 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1312/2643] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:23.640439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d4408-4fea-4160-b595-d8d03906c5b4 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:23.642828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-370d4408-4fea-4160-b595-d8d03906c5b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:23.713236 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d4408-4fea-4160-b595-d8d03906c5b4 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:23.717416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c4b9be-edf3-42db-b11e-0195c4292a61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:23.718084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4b9be-edf3-42db-b11e-0195c4292a61 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:23.718321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4b9be-edf3-42db-b11e-0195c4292a61 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:23.718699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c4b9be-edf3-42db-b11e-0195c4292a61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:23.727475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4b9be-edf3-42db-b11e-0195c4292a61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:23.728936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c4b9be-edf3-42db-b11e-0195c4292a61 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:23.738287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1332/2644] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:30.026169 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09e1ba-aa8e-455d-87f3-ef4c5cf16057 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:30.100090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc09e1ba-aa8e-455d-87f3-ef4c5cf16057 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:30.105240 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:30.105877 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:30.106154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:30.106427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] PATH_INFO: `/v3/users/24205e0903614fe2a6cdfd133667b5ef` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:30.107675 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24205e0903614fe2a6cdfd133667b5ef)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:30.109618 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:30.170031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24205e0903614fe2a6cdfd133667b5ef'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:30.170706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24205e0903614fe2a6cdfd133667b5ef'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:30.171359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24205e0903614fe2a6cdfd133667b5ef'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:30.184165 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24205e0903614fe2a6cdfd133667b5ef'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:30.193036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6be0974a-0179-46ef-b2cb-609dc9db0ee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24205e0903614fe2a6cdfd133667b5ef'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:30.205632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1313/2645] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:30 2022] DELETE /identity/v3/users/24205e0903614fe2a6cdfd133667b5ef => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:30.210096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd0b1-431a-49e2-a012-803e37992762 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:30.210618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd0b1-431a-49e2-a012-803e37992762 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:30.210618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd0b1-431a-49e2-a012-803e37992762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:30.212903 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fc348-bfc8-49b7-8de1-e17bfda19b7b None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:30.213196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fc348-bfc8-49b7-8de1-e17bfda19b7b None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:30.213470 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fc348-bfc8-49b7-8de1-e17bfda19b7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:30.229642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-436bd0b1-431a-49e2-a012-803e37992762 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:30.230880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-436bd0b1-431a-49e2-a012-803e37992762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:30.232515 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-6c3fc348-bfc8-49b7-8de1-e17bfda19b7b None None] MFA Rules not processed for user `bfe3817d4e7241e689e6ecc095e938ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:30.233690 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6c3fc348-bfc8-49b7-8de1-e17bfda19b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:30.260029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:30.296014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1333/2646] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:30.296890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1314/2647] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:30 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:30.307830 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bd0b1-431a-49e2-a012-803e37992762 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:30.309221 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-436bd0b1-431a-49e2-a012-803e37992762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:30.329439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:30.378231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bd0b1-431a-49e2-a012-803e37992762 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:30.381806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14a4e-daa6-4c07-a822-9d4821ead78f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:30.382420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14a4e-daa6-4c07-a822-9d4821ead78f service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:30.382705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14a4e-daa6-4c07-a822-9d4821ead78f service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:30.383028 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e14a4e-daa6-4c07-a822-9d4821ead78f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:30.393912 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e14a4e-daa6-4c07-a822-9d4821ead78f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:30.395562 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e14a4e-daa6-4c07-a822-9d4821ead78f service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:30.408988 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1334/2648] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:30.712713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fc348-bfc8-49b7-8de1-e17bfda19b7b None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:30.714634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6c3fc348-bfc8-49b7-8de1-e17bfda19b7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:30.744962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fc348-bfc8-49b7-8de1-e17bfda19b7b None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:30.751621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:30.752378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:30.752717 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:30.753056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] PATH_INFO: `/v3/projects/7a27b790b1bc417bafecb58cee816634` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:30.757428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a27b790b1bc417bafecb58cee816634)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:30.766599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:30.828665 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a27b790b1bc417bafecb58cee816634', 'request_id': 'req-849c1997-7688-4e5c-b326-dac0505ab170'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:30.840228 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a27b790b1bc417bafecb58cee816634', 'request_id': 'req-849c1997-7688-4e5c-b326-dac0505ab170'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:30.847697 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a27b790b1bc417bafecb58cee816634', 'request_id': 'req-849c1997-7688-4e5c-b326-dac0505ab170'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:30.861624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] The token cache is being invalidate because project 7a27b790b1bc417bafecb58cee816634 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:30.861918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:30.862680 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:30.864567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1315/2649] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:30 2022] DELETE /identity/v3/projects/7a27b790b1bc417bafecb58cee816634 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:32.372577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14a4e-daa6-4c07-a822-9d4821ead78f service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:32.374136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f2e14a4e-daa6-4c07-a822-9d4821ead78f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:32.393316 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e14a4e-daa6-4c07-a822-9d4821ead78f service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:32.453025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:32.454568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:32.490944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:32.491760 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:32.492090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:32.492578 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] PATH_INFO: `/v3/users/a8d6ce1791da443897225960a701d5bb` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:32.494149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8d6ce1791da443897225960a701d5bb)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:32.497038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:32.544626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c1997-7688-4e5c-b326-dac0505ab170 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:32.550353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:32.551039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:32.551328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:32.551602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] PATH_INFO: `/v3/users/5156400d2b8e477e8b3aab2c2ba7ff1d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:32.552823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5156400d2b8e477e8b3aab2c2ba7ff1d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:32.554669 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:32.568017 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8d6ce1791da443897225960a701d5bb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:32.583854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8d6ce1791da443897225960a701d5bb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:32.592810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8d6ce1791da443897225960a701d5bb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:32.601851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8d6ce1791da443897225960a701d5bb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:32.602635 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-158f9bc9-0cfd-4000-abb0-e7b2fe40771e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8d6ce1791da443897225960a701d5bb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:32.609594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1335/2650] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:32 2022] DELETE /identity/v3/users/a8d6ce1791da443897225960a701d5bb => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:32.613506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5156400d2b8e477e8b3aab2c2ba7ff1d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:32.614263 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5156400d2b8e477e8b3aab2c2ba7ff1d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:32.614612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024044-fd97-43f2-8911-2ad5bfb48c41 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:32.615074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024044-fd97-43f2-8911-2ad5bfb48c41 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:32.615376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67024044-fd97-43f2-8911-2ad5bfb48c41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:32.615486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5156400d2b8e477e8b3aab2c2ba7ff1d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:32.628208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:32.636711 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-67024044-fd97-43f2-8911-2ad5bfb48c41 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:32.638083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-67024044-fd97-43f2-8911-2ad5bfb48c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:32.640485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5156400d2b8e477e8b3aab2c2ba7ff1d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:32.651892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-abba4f12-527a-4d71-8813-1021c95e1ae7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5156400d2b8e477e8b3aab2c2ba7ff1d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:32.666640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1316/2651] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:32 2022] DELETE /identity/v3/users/5156400d2b8e477e8b3aab2c2ba7ff1d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:32.671052 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e03e-2fc3-4b83-b918-dfc5ea14f721 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:32.671407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e03e-2fc3-4b83-b918-dfc5ea14f721 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:32.671751 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921e03e-2fc3-4b83-b918-dfc5ea14f721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:32.681995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:32.692923 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7921e03e-2fc3-4b83-b918-dfc5ea14f721 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:32.694080 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7921e03e-2fc3-4b83-b918-dfc5ea14f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:32.718266 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1336/2652] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:32.733390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67024044-fd97-43f2-8911-2ad5bfb48c41 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:32.735068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-67024044-fd97-43f2-8911-2ad5bfb48c41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:32.772206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1317/2653] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:32.787525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921e03e-2fc3-4b83-b918-dfc5ea14f721 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:32.790155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7921e03e-2fc3-4b83-b918-dfc5ea14f721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:32.816984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67024044-fd97-43f2-8911-2ad5bfb48c41 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:32.880882 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921e03e-2fc3-4b83-b918-dfc5ea14f721 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:32.887335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf847a8a-070e-428c-8d54-ca852363e969 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:32.888614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf847a8a-070e-428c-8d54-ca852363e969 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:32.888956 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf847a8a-070e-428c-8d54-ca852363e969 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:32.889275 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf847a8a-070e-428c-8d54-ca852363e969 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:32.898386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7061bd-41e3-44e3-8822-d99d41f0ebbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:32.899269 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7061bd-41e3-44e3-8822-d99d41f0ebbe service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:32.899631 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7061bd-41e3-44e3-8822-d99d41f0ebbe service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:32.900019 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7061bd-41e3-44e3-8822-d99d41f0ebbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:32.905088 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf847a8a-070e-428c-8d54-ca852363e969 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:32.907638 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf847a8a-070e-428c-8d54-ca852363e969 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:32.914392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7061bd-41e3-44e3-8822-d99d41f0ebbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:32.915953 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7061bd-41e3-44e3-8822-d99d41f0ebbe service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:32.922676 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1318/2654] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:32.927606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1337/2655] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:14:33.227164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf847a8a-070e-428c-8d54-ca852363e969 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:33.229467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bf847a8a-070e-428c-8d54-ca852363e969 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:33.250097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf847a8a-070e-428c-8d54-ca852363e969 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:33.255083 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:33.255731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:33.256011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:33.256285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] PATH_INFO: `/v3/projects/5ddd67d3ed7c44d38c9214b2fae1d2e7` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:33.257475 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ddd67d3ed7c44d38c9214b2fae1d2e7)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:33.259698 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:33.339154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ddd67d3ed7c44d38c9214b2fae1d2e7', 'request_id': 'req-b1596525-d0e2-4647-86c6-53262136cec0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:33.351949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ddd67d3ed7c44d38c9214b2fae1d2e7', 'request_id': 'req-b1596525-d0e2-4647-86c6-53262136cec0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:33.361145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ddd67d3ed7c44d38c9214b2fae1d2e7', 'request_id': 'req-b1596525-d0e2-4647-86c6-53262136cec0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:33.378167 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] The token cache is being invalidate because project 5ddd67d3ed7c44d38c9214b2fae1d2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:33.378167 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:33.378890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:33.380761 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1319/2656] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:33 2022] DELETE /identity/v3/projects/5ddd67d3ed7c44d38c9214b2fae1d2e7 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:33.385714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7061bd-41e3-44e3-8822-d99d41f0ebbe service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:33.399308 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7061bd-41e3-44e3-8822-d99d41f0ebbe service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:33.476923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:33.477619 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:33.478136 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:33.478923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] PATH_INFO: `/v3/users/67c1b983fdf94228997fb915e7088e41` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:33.480840 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67c1b983fdf94228997fb915e7088e41)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:33.482844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:33.542878 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:33.553442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67c1b983fdf94228997fb915e7088e41'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:33.568104 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67c1b983fdf94228997fb915e7088e41'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:33.578816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67c1b983fdf94228997fb915e7088e41'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:33.587459 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67c1b983fdf94228997fb915e7088e41'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:33.588298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67c1b983fdf94228997fb915e7088e41'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:33.596751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1338/2657] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:33 2022] DELETE /identity/v3/users/67c1b983fdf94228997fb915e7088e41 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:33.841271 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:33.842832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:33.857523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:33.871579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1596525-d0e2-4647-86c6-53262136cec0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:33.946796 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:33.947674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:33.947953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:33.948277 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] PATH_INFO: `/v3/projects/9a533ed12a3a4b47a9bbd85638b3b0d8` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:33.949476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a533ed12a3a4b47a9bbd85638b3b0d8)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:33.951563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.009991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a533ed12a3a4b47a9bbd85638b3b0d8', 'request_id': 'req-11722484-3258-422c-9db6-6032aebab241'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.021520 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a533ed12a3a4b47a9bbd85638b3b0d8', 'request_id': 'req-11722484-3258-422c-9db6-6032aebab241'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.030151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a533ed12a3a4b47a9bbd85638b3b0d8', 'request_id': 'req-11722484-3258-422c-9db6-6032aebab241'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.043776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] The token cache is being invalidate because project 9a533ed12a3a4b47a9bbd85638b3b0d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:34.044221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.044950 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.046809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1320/2658] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:33 2022] DELETE /identity/v3/projects/9a533ed12a3a4b47a9bbd85638b3b0d8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:34.051124 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.053084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:34.066610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae37f401-39ba-4928-949e-e76a28746614 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.096184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.097770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:34.149206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.150849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.151248 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.151658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] PATH_INFO: `/v3/users/e925dde6d9244b94972070b2ca777e3c` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.152969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e925dde6d9244b94972070b2ca777e3c)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.155716 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.229302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11722484-3258-422c-9db6-6032aebab241 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.230719 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e925dde6d9244b94972070b2ca777e3c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.234024 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.234658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.234976 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.235246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] PATH_INFO: `/v3/projects/6de57cde7cc04a91b4d45e991a288b0d` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.236663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6de57cde7cc04a91b4d45e991a288b0d)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.238759 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.245947 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e925dde6d9244b94972070b2ca777e3c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.255491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e925dde6d9244b94972070b2ca777e3c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.264473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e925dde6d9244b94972070b2ca777e3c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.265163 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-e0b95496-185a-432c-bef8-f04701a971a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e925dde6d9244b94972070b2ca777e3c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.273237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1339/2659] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:34 2022] DELETE /identity/v3/users/e925dde6d9244b94972070b2ca777e3c => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:34.286322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:34.300341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6de57cde7cc04a91b4d45e991a288b0d', 'request_id': 'req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.311896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6de57cde7cc04a91b4d45e991a288b0d', 'request_id': 'req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.320565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6de57cde7cc04a91b4d45e991a288b0d', 'request_id': 'req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.333642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] The token cache is being invalidate because project 6de57cde7cc04a91b4d45e991a288b0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:34.333938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.334752 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-cd95d3f6-eb63-4d0a-9fe9-12f464be2d5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.336341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1321/2660] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:34 2022] DELETE /identity/v3/projects/6de57cde7cc04a91b4d45e991a288b0d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:34.341698 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170548a-67e5-4e02-b5ff-77ecd1f4e50f None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.341915 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170548a-67e5-4e02-b5ff-77ecd1f4e50f None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.342197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2170548a-67e5-4e02-b5ff-77ecd1f4e50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.364625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-2170548a-67e5-4e02-b5ff-77ecd1f4e50f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:34.365972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2170548a-67e5-4e02-b5ff-77ecd1f4e50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:34.402888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:34.443472 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1340/2661] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:34.450570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75443-f34b-4323-be17-0dab8383687f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.451445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75443-f34b-4323-be17-0dab8383687f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.451757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc75443-f34b-4323-be17-0dab8383687f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.474686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-afc75443-f34b-4323-be17-0dab8383687f None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:34.475984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-afc75443-f34b-4323-be17-0dab8383687f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:34.486363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1322/2662] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:34.490268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170548a-67e5-4e02-b5ff-77ecd1f4e50f None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.501591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2170548a-67e5-4e02-b5ff-77ecd1f4e50f None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.506375 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece58d2c-03c9-42b8-bcd3-6b935c9f15a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.507022 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece58d2c-03c9-42b8-bcd3-6b935c9f15a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.507298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece58d2c-03c9-42b8-bcd3-6b935c9f15a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.507590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece58d2c-03c9-42b8-bcd3-6b935c9f15a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.508270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece58d2c-03c9-42b8-bcd3-6b935c9f15a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:34.508567 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece58d2c-03c9-42b8-bcd3-6b935c9f15a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.510414 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece58d2c-03c9-42b8-bcd3-6b935c9f15a2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.522795 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1341/2663] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:14:34.527478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75443-f34b-4323-be17-0dab8383687f None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.536758 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc75443-f34b-4323-be17-0dab8383687f None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.541889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b2d7-e263-45d0-a904-da582e7505fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.542503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b2d7-e263-45d0-a904-da582e7505fe admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.542811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b2d7-e263-45d0-a904-da582e7505fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.543077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1b2d7-e263-45d0-a904-da582e7505fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.543716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b2d7-e263-45d0-a904-da582e7505fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.545688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e1b2d7-e263-45d0-a904-da582e7505fe admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.575399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece58d2c-03c9-42b8-bcd3-6b935c9f15a2 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.577167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ece58d2c-03c9-42b8-bcd3-6b935c9f15a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:34.583075 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1323/2664] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:34 2022] POST /identity/v3/projects => generated 369 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:34.587737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b2d7-e263-45d0-a904-da582e7505fe admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.595796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece58d2c-03c9-42b8-bcd3-6b935c9f15a2 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.661688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.662969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.663253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.663555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] PATH_INFO: `/v3/projects/9c55a0a2c42743c2b65d291a35735e66` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.664737 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c55a0a2c42743c2b65d291a35735e66)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.666761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.667034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1b2d7-e263-45d0-a904-da582e7505fe admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.672927 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1219dd-ddf0-4fbe-ad57-f5678ac7b352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.674197 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1219dd-ddf0-4fbe-ad57-f5678ac7b352 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.674689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1219dd-ddf0-4fbe-ad57-f5678ac7b352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.675108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1219dd-ddf0-4fbe-ad57-f5678ac7b352 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.676261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1219dd-ddf0-4fbe-ad57-f5678ac7b352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.678230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1219dd-ddf0-4fbe-ad57-f5678ac7b352 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.702102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1324/2665] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:34 2022] POST /identity/v3/users => generated 285 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:34.706288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1219dd-ddf0-4fbe-ad57-f5678ac7b352 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.716270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1219dd-ddf0-4fbe-ad57-f5678ac7b352 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.718666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c55a0a2c42743c2b65d291a35735e66', 'request_id': 'req-42ece860-30c0-420d-9168-7c548053b9c2'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.724802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c55a0a2c42743c2b65d291a35735e66', 'request_id': 'req-42ece860-30c0-420d-9168-7c548053b9c2'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.735251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c55a0a2c42743c2b65d291a35735e66', 'request_id': 'req-42ece860-30c0-420d-9168-7c548053b9c2'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.748620 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] The token cache is being invalidate because project 9c55a0a2c42743c2b65d291a35735e66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:34.748929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.749621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-42ece860-30c0-420d-9168-7c548053b9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:34.751443 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1342/2666] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:34 2022] DELETE /identity/v3/projects/9c55a0a2c42743c2b65d291a35735e66 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:34.756579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bfee6-ef39-4634-97fc-f53018de592e None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.756936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bfee6-ef39-4634-97fc-f53018de592e None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.757277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706bfee6-ef39-4634-97fc-f53018de592e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.778877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-706bfee6-ef39-4634-97fc-f53018de592e None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:34.780332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-706bfee6-ef39-4634-97fc-f53018de592e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:34.782037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9d621-c505-467b-9b51-b1d854a456b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.782633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9d621-c505-467b-9b51-b1d854a456b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.782942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9d621-c505-467b-9b51-b1d854a456b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.783214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb9d621-c505-467b-9b51-b1d854a456b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.783869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9d621-c505-467b-9b51-b1d854a456b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.785507 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb9d621-c505-467b-9b51-b1d854a456b1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.788589 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1343/2667] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:34.796323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1325/2668] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:34.800137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9d621-c505-467b-9b51-b1d854a456b1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.800577 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae84623-1366-46de-b130-d52e49558c97 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.800857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae84623-1366-46de-b130-d52e49558c97 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.801126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae84623-1366-46de-b130-d52e49558c97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.802320 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ccb9d621-c505-467b-9b51-b1d854a456b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:34.820942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb9d621-c505-467b-9b51-b1d854a456b1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.822614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-2ae84623-1366-46de-b130-d52e49558c97 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:34.823860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-2ae84623-1366-46de-b130-d52e49558c97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:34.826177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64f602-ad8e-4b08-9b0e-d744b97528fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.826799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64f602-ad8e-4b08-9b0e-d744b97528fb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.827097 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64f602-ad8e-4b08-9b0e-d744b97528fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.827363 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64f602-ad8e-4b08-9b0e-d744b97528fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.828006 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64f602-ad8e-4b08-9b0e-d744b97528fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.829592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64f602-ad8e-4b08-9b0e-d744b97528fb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.834292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1344/2669] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:34.838608 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae84623-1366-46de-b130-d52e49558c97 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.841811 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1326/2670] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:34 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:34.846068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64f602-ad8e-4b08-9b0e-d744b97528fb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.848863 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae84623-1366-46de-b130-d52e49558c97 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.853790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a71e3-9e46-4d73-beb1-e1840dada83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.855128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a71e3-9e46-4d73-beb1-e1840dada83f admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.855128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a71e3-9e46-4d73-beb1-e1840dada83f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.855128 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a71e3-9e46-4d73-beb1-e1840dada83f admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.856013 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a71e3-9e46-4d73-beb1-e1840dada83f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:34.856490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64f602-ad8e-4b08-9b0e-d744b97528fb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.858959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a71e3-9e46-4d73-beb1-e1840dada83f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.860739 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a71e3-9e46-4d73-beb1-e1840dada83f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.861597 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aba45c-3ed8-44aa-9978-e39f0a027b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.862246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aba45c-3ed8-44aa-9978-e39f0a027b50 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.862657 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aba45c-3ed8-44aa-9978-e39f0a027b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.863121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aba45c-3ed8-44aa-9978-e39f0a027b50 admin admin] PATH_INFO: `/v3/projects/f5c455722c00497888fed52ec9851879/users/b7d7cf73181243baafc7cad07dbef465/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.866764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:34.877531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1345/2671] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:14:34.879280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a71e3-9e46-4d73-beb1-e1840dada83f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:34.882802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aba45c-3ed8-44aa-9978-e39f0a027b50 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c455722c00497888fed52ec9851879, user_id=b7d7cf73181243baafc7cad07dbef465, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.886513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aba45c-3ed8-44aa-9978-e39f0a027b50 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:34.901728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a71e3-9e46-4d73-beb1-e1840dada83f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:34.904731 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1327/2672] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:34 2022] PUT /identity/v3/projects/f5c455722c00497888fed52ec9851879/users/b7d7cf73181243baafc7cad07dbef465/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:34.916231 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec189de-c13f-4002-a37b-76914379c078 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.916518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec189de-c13f-4002-a37b-76914379c078 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.916797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec189de-c13f-4002-a37b-76914379c078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.943990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:34.967493 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-8ec189de-c13f-4002-a37b-76914379c078 None None] MFA Rules not processed for user `b7d7cf73181243baafc7cad07dbef465`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:34.968953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8ec189de-c13f-4002-a37b-76914379c078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:34.989209 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6eb32-ac1a-4dbd-a52c-b99e4adb16e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:34.990193 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6eb32-ac1a-4dbd-a52c-b99e4adb16e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:34.990649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6eb32-ac1a-4dbd-a52c-b99e4adb16e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:34.991099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba6eb32-ac1a-4dbd-a52c-b99e4adb16e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:34.992255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6eb32-ac1a-4dbd-a52c-b99e4adb16e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:34.995324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba6eb32-ac1a-4dbd-a52c-b99e4adb16e2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.032323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1346/2673] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:34 2022] POST /identity/v3/projects => generated 367 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:35.036522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6eb32-ac1a-4dbd-a52c-b99e4adb16e2 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.052425 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1328/2674] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:35.057157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec189de-c13f-4002-a37b-76914379c078 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.068960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec189de-c13f-4002-a37b-76914379c078 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.104079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba6eb32-ac1a-4dbd-a52c-b99e4adb16e2 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.108870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ea4e3-f134-4c70-89d0-d2b6081e5e68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.109489 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ea4e3-f134-4c70-89d0-d2b6081e5e68 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.109767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ea4e3-f134-4c70-89d0-d2b6081e5e68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.110040 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65ea4e3-f134-4c70-89d0-d2b6081e5e68 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.110854 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ea4e3-f134-4c70-89d0-d2b6081e5e68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.112679 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65ea4e3-f134-4c70-89d0-d2b6081e5e68 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.130581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5a624-c68b-458d-9fc0-6a1c91263aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.131236 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5a624-c68b-458d-9fc0-6a1c91263aa4 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.131514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5a624-c68b-458d-9fc0-6a1c91263aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.132001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d5a624-c68b-458d-9fc0-6a1c91263aa4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.132462 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5a624-c68b-458d-9fc0-6a1c91263aa4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.134482 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d5a624-c68b-458d-9fc0-6a1c91263aa4 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.137390 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1347/2675] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:35 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:35.141604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ea4e3-f134-4c70-89d0-d2b6081e5e68 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.151896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65ea4e3-f134-4c70-89d0-d2b6081e5e68 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.157800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590864a9-1169-4cea-8d21-6491318ae9f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.158507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590864a9-1169-4cea-8d21-6491318ae9f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.158880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590864a9-1169-4cea-8d21-6491318ae9f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.159153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590864a9-1169-4cea-8d21-6491318ae9f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.160085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590864a9-1169-4cea-8d21-6491318ae9f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.161467 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-590864a9-1169-4cea-8d21-6491318ae9f7 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.166544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1329/2676] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:35 2022] POST /identity/v3/projects => generated 369 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:35.170635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5a624-c68b-458d-9fc0-6a1c91263aa4 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.175591 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1348/2677] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:35.180445 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590864a9-1169-4cea-8d21-6491318ae9f7 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.193261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590864a9-1169-4cea-8d21-6491318ae9f7 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.245267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d5a624-c68b-458d-9fc0-6a1c91263aa4 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.251157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78529e77-2035-4fd5-b321-eb3a9625218d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.252016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529e77-2035-4fd5-b321-eb3a9625218d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.252451 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529e77-2035-4fd5-b321-eb3a9625218d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.252866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78529e77-2035-4fd5-b321-eb3a9625218d admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.253688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78529e77-2035-4fd5-b321-eb3a9625218d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.256762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78529e77-2035-4fd5-b321-eb3a9625218d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.259460 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7f44-0cb9-41ba-a312-080f38f43451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.260164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7f44-0cb9-41ba-a312-080f38f43451 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.260440 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7f44-0cb9-41ba-a312-080f38f43451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.260714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0be7f44-0cb9-41ba-a312-080f38f43451 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.261364 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be7f44-0cb9-41ba-a312-080f38f43451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.262972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0be7f44-0cb9-41ba-a312-080f38f43451 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.267046 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:35.280869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1349/2678] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:35.281905 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7f44-0cb9-41ba-a312-080f38f43451 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.289349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1330/2679] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:35 2022] POST /identity/v3/users => generated 291 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:35.290336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78529e77-2035-4fd5-b321-eb3a9625218d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.295247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0be7f44-0cb9-41ba-a312-080f38f43451 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.302219 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78529e77-2035-4fd5-b321-eb3a9625218d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.303142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e705a3-68f1-4c38-9ebd-a17132254bca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.303959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e705a3-68f1-4c38-9ebd-a17132254bca admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.304273 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e705a3-68f1-4c38-9ebd-a17132254bca admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.304602 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e705a3-68f1-4c38-9ebd-a17132254bca admin admin] PATH_INFO: `/v3/projects/aac4028a418844bcbfe6699082078e8a/users/a66dbb7280a044248ff35760150e028a/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.308300 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66802df9-91ed-46b1-ad6b-636dfa2f5955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.308910 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802df9-91ed-46b1-ad6b-636dfa2f5955 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.309187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802df9-91ed-46b1-ad6b-636dfa2f5955 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.309456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66802df9-91ed-46b1-ad6b-636dfa2f5955 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.310115 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66802df9-91ed-46b1-ad6b-636dfa2f5955 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.311762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66802df9-91ed-46b1-ad6b-636dfa2f5955 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.323735 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e705a3-68f1-4c38-9ebd-a17132254bca admin admin] RBAC: Authorizing `identity:create_grant(project_id=aac4028a418844bcbfe6699082078e8a, user_id=a66dbb7280a044248ff35760150e028a, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.324350 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1331/2680] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:35.328146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66802df9-91ed-46b1-ad6b-636dfa2f5955 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.329694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e705a3-68f1-4c38-9ebd-a17132254bca admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.340600 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66802df9-91ed-46b1-ad6b-636dfa2f5955 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.348102 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1350/2681] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:35 2022] PUT /identity/v3/projects/aac4028a418844bcbfe6699082078e8a/users/a66dbb7280a044248ff35760150e028a/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:35.358804 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af25a-3422-4665-9954-e00116c4a9b9 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.359052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af25a-3422-4665-9954-e00116c4a9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.359299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4af25a-3422-4665-9954-e00116c4a9b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.366397 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:35.391524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-8d4af25a-3422-4665-9954-e00116c4a9b9 None None] MFA Rules not processed for user `a66dbb7280a044248ff35760150e028a`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:35.393365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8d4af25a-3422-4665-9954-e00116c4a9b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:35.408210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9872e-6751-4fec-aa12-cdb9e98995ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.411450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9872e-6751-4fec-aa12-cdb9e98995ee admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.411908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9872e-6751-4fec-aa12-cdb9e98995ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.412331 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b9872e-6751-4fec-aa12-cdb9e98995ee admin admin] PATH_INFO: `/v3/projects/cdd8d62c53b942bd8886dda938bd6605/users/d3818716f1af4b6391bb845a97d580d0/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.436583 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9872e-6751-4fec-aa12-cdb9e98995ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd8d62c53b942bd8886dda938bd6605, user_id=d3818716f1af4b6391bb845a97d580d0, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.439467 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b9872e-6751-4fec-aa12-cdb9e98995ee admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.459059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1332/2682] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:35 2022] PUT /identity/v3/projects/cdd8d62c53b942bd8886dda938bd6605/users/d3818716f1af4b6391bb845a97d580d0/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:35.463340 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9872e-6751-4fec-aa12-cdb9e98995ee admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.475670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1351/2683] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:35.480183 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4af25a-3422-4665-9954-e00116c4a9b9 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.490639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4af25a-3422-4665-9954-e00116c4a9b9 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.527553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b9872e-6751-4fec-aa12-cdb9e98995ee admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.532599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86de06-5b3b-4413-9e25-2067a2bc6ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.533194 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86de06-5b3b-4413-9e25-2067a2bc6ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.533448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86de06-5b3b-4413-9e25-2067a2bc6ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.533729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae86de06-5b3b-4413-9e25-2067a2bc6ce3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.534370 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86de06-5b3b-4413-9e25-2067a2bc6ce3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.536132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae86de06-5b3b-4413-9e25-2067a2bc6ce3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.546790 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1333/2684] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:35.547918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253038c-df74-455a-b45e-de29673683a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.548531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253038c-df74-455a-b45e-de29673683a3 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.548808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253038c-df74-455a-b45e-de29673683a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.549069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253038c-df74-455a-b45e-de29673683a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.549684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253038c-df74-455a-b45e-de29673683a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.551145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86de06-5b3b-4413-9e25-2067a2bc6ce3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.551624 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253038c-df74-455a-b45e-de29673683a3 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.560985 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae86de06-5b3b-4413-9e25-2067a2bc6ce3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.565973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe4f207-bbff-4ef3-b618-df7790c8b523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.566642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f207-bbff-4ef3-b618-df7790c8b523 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.566949 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f207-bbff-4ef3-b618-df7790c8b523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.567222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe4f207-bbff-4ef3-b618-df7790c8b523 admin admin] PATH_INFO: `/v3/projects/cdd8d62c53b942bd8886dda938bd6605/users/d3818716f1af4b6391bb845a97d580d0/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.569266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4f207-bbff-4ef3-b618-df7790c8b523 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd8d62c53b942bd8886dda938bd6605, user_id=d3818716f1af4b6391bb845a97d580d0, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.572050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe4f207-bbff-4ef3-b618-df7790c8b523 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.582815 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1352/2685] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:35 2022] POST /identity/v3/projects => generated 367 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:35.584125 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253038c-df74-455a-b45e-de29673683a3 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.586562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1334/2686] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:35 2022] PUT /identity/v3/projects/cdd8d62c53b942bd8886dda938bd6605/users/d3818716f1af4b6391bb845a97d580d0/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:35.598050 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c896c-4bfd-40c2-a80a-c226c8d2786e None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.598333 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c896c-4bfd-40c2-a80a-c226c8d2786e None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.598603 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4c896c-4bfd-40c2-a80a-c226c8d2786e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.626521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ea4c896c-4bfd-40c2-a80a-c226c8d2786e None None] MFA Rules not processed for user `d3818716f1af4b6391bb845a97d580d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:35.627716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ea4c896c-4bfd-40c2-a80a-c226c8d2786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:35.649614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253038c-df74-455a-b45e-de29673683a3 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.654325 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e595da3-d2f7-48dd-82fe-68dd42f55525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.654971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e595da3-d2f7-48dd-82fe-68dd42f55525 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.655254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e595da3-d2f7-48dd-82fe-68dd42f55525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.655520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e595da3-d2f7-48dd-82fe-68dd42f55525 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.656140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e595da3-d2f7-48dd-82fe-68dd42f55525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.658081 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e595da3-d2f7-48dd-82fe-68dd42f55525 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.660772 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:35.683690 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1353/2687] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:35 2022] POST /identity/v3/users => generated 290 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:35.687598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e595da3-d2f7-48dd-82fe-68dd42f55525 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.698527 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e595da3-d2f7-48dd-82fe-68dd42f55525 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.703476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2e581-3199-49c4-9a89-aed846a21362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.704349 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2e581-3199-49c4-9a89-aed846a21362 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.704485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1335/2688] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:35.704603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2e581-3199-49c4-9a89-aed846a21362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.704603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2e581-3199-49c4-9a89-aed846a21362 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.705231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2e581-3199-49c4-9a89-aed846a21362 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.706931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c2e581-3199-49c4-9a89-aed846a21362 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.712853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:35.716164 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c896c-4bfd-40c2-a80a-c226c8d2786e None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.717720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ea4c896c-4bfd-40c2-a80a-c226c8d2786e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:35.718247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1354/2689] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:35.722166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2e581-3199-49c4-9a89-aed846a21362 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.732665 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c2e581-3199-49c4-9a89-aed846a21362 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.737351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c7f9-f1b1-4ec1-8fb1-c7ace5666d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.738061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c7f9-f1b1-4ec1-8fb1-c7ace5666d7c admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.738339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c7f9-f1b1-4ec1-8fb1-c7ace5666d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.738605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c7f9-f1b1-4ec1-8fb1-c7ace5666d7c admin admin] PATH_INFO: `/v3/projects/0e1efcea00b04f25bee838ea4224853d/users/7b641ec286a345d8acddba6e3aeb34bb/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.754647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7c7f9-f1b1-4ec1-8fb1-c7ace5666d7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1efcea00b04f25bee838ea4224853d, user_id=7b641ec286a345d8acddba6e3aeb34bb, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.757617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7c7f9-f1b1-4ec1-8fb1-c7ace5666d7c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.779378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4c896c-4bfd-40c2-a80a-c226c8d2786e None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.781519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1355/2690] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:35 2022] PUT /identity/v3/projects/0e1efcea00b04f25bee838ea4224853d/users/7b641ec286a345d8acddba6e3aeb34bb/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:35.785372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c7f9-f1b1-4ec1-8fb1-c7ace5666d7c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.835473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91654fd5-7231-459c-ad14-bed5ce225a76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.836082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91654fd5-7231-459c-ad14-bed5ce225a76 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.836360 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91654fd5-7231-459c-ad14-bed5ce225a76 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.836684 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91654fd5-7231-459c-ad14-bed5ce225a76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.860451 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c7f9-f1b1-4ec1-8fb1-c7ace5666d7c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.867869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78624d35-e230-47bf-a3f4-cd88d1a469c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.869061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78624d35-e230-47bf-a3f4-cd88d1a469c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.869346 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78624d35-e230-47bf-a3f4-cd88d1a469c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.869623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78624d35-e230-47bf-a3f4-cd88d1a469c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.870280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78624d35-e230-47bf-a3f4-cd88d1a469c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.871947 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78624d35-e230-47bf-a3f4-cd88d1a469c8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.885386 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1356/2691] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:35 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:35.886747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78624d35-e230-47bf-a3f4-cd88d1a469c8 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.896573 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78624d35-e230-47bf-a3f4-cd88d1a469c8 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:35.898960 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91654fd5-7231-459c-ad14-bed5ce225a76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.900571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91654fd5-7231-459c-ad14-bed5ce225a76 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.902010 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8de2-cf5a-47ac-8b1a-0d5aaf5ac7e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:35.902666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8de2-cf5a-47ac-8b1a-0d5aaf5ac7e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.902990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8de2-cf5a-47ac-8b1a-0d5aaf5ac7e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.903261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344d8de2-cf5a-47ac-8b1a-0d5aaf5ac7e8 admin admin] PATH_INFO: `/v3/projects/0e1efcea00b04f25bee838ea4224853d/users/7b641ec286a345d8acddba6e3aeb34bb/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.905194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d8de2-cf5a-47ac-8b1a-0d5aaf5ac7e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e1efcea00b04f25bee838ea4224853d, user_id=7b641ec286a345d8acddba6e3aeb34bb, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:35.907877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344d8de2-cf5a-47ac-8b1a-0d5aaf5ac7e8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:35.910511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1336/2692] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:35.919545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1357/2693] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:35 2022] PUT /identity/v3/projects/0e1efcea00b04f25bee838ea4224853d/users/7b641ec286a345d8acddba6e3aeb34bb/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:35.931538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445cd3b-27e6-419c-91a5-78f05101567d None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:35.931872 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445cd3b-27e6-419c-91a5-78f05101567d None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:35.932155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b445cd3b-27e6-419c-91a5-78f05101567d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:35.959096 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8de2-cf5a-47ac-8b1a-0d5aaf5ac7e8 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:35.960937 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-344d8de2-cf5a-47ac-8b1a-0d5aaf5ac7e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:35.961929 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b445cd3b-27e6-419c-91a5-78f05101567d None None] MFA Rules not processed for user `7b641ec286a345d8acddba6e3aeb34bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:35.963353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b445cd3b-27e6-419c-91a5-78f05101567d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:35.990156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:36.027107 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344d8de2-cf5a-47ac-8b1a-0d5aaf5ac7e8 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:36.031470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384e899-efa6-4c90-9a17-70570b5f07d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:36.032100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e899-efa6-4c90-9a17-70570b5f07d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:36.032374 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e899-efa6-4c90-9a17-70570b5f07d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:36.032640 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6384e899-efa6-4c90-9a17-70570b5f07d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:36.040210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1337/2694] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:35 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:36.054817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445cd3b-27e6-419c-91a5-78f05101567d None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:36.066107 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b445cd3b-27e6-419c-91a5-78f05101567d None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:36.071025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823a207-2b63-4fdd-af69-64f6310ce5d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:36.072456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823a207-2b63-4fdd-af69-64f6310ce5d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:36.073118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823a207-2b63-4fdd-af69-64f6310ce5d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:36.073643 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a823a207-2b63-4fdd-af69-64f6310ce5d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:36.084784 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823a207-2b63-4fdd-af69-64f6310ce5d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:36.086494 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a823a207-2b63-4fdd-af69-64f6310ce5d8 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:36.097204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384e899-efa6-4c90-9a17-70570b5f07d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:36.098662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1338/2695] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:14:36.098887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6384e899-efa6-4c90-9a17-70570b5f07d1 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:36.108558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1358/2696] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:35 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:36.194078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823a207-2b63-4fdd-af69-64f6310ce5d8 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:36.204247 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a823a207-2b63-4fdd-af69-64f6310ce5d8 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:36.208452 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fe9cb0-8932-47d0-8fd5-325243d45e39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:36.209329 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe9cb0-8932-47d0-8fd5-325243d45e39 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:36.209711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe9cb0-8932-47d0-8fd5-325243d45e39 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:36.210078 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fe9cb0-8932-47d0-8fd5-325243d45e39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:36.285371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe9cb0-8932-47d0-8fd5-325243d45e39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:36.286894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fe9cb0-8932-47d0-8fd5-325243d45e39 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:36.298191 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1339/2697] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:36 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:39.560033 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384e899-efa6-4c90-9a17-70570b5f07d1 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:39.570458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:39.634303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6384e899-efa6-4c90-9a17-70570b5f07d1 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:39.639520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:39.640241 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:39.640611 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:39.641344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] PATH_INFO: `/v3/users/b7d7cf73181243baafc7cad07dbef465` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:39.642790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7d7cf73181243baafc7cad07dbef465)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:39.652195 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:39.710180 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7d7cf73181243baafc7cad07dbef465'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:39.734886 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7d7cf73181243baafc7cad07dbef465'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:39.745708 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7d7cf73181243baafc7cad07dbef465'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:39.755059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7d7cf73181243baafc7cad07dbef465'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:39.760348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7d7cf73181243baafc7cad07dbef465'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:39.769983 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1359/2698] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:39 2022] DELETE /identity/v3/users/b7d7cf73181243baafc7cad07dbef465 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:39.774968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45e18d-b35e-4e2c-a150-61a0416079a6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:39.775823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45e18d-b35e-4e2c-a150-61a0416079a6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:39.775823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a45e18d-b35e-4e2c-a150-61a0416079a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:39.795866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0a45e18d-b35e-4e2c-a150-61a0416079a6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:39.797074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0a45e18d-b35e-4e2c-a150-61a0416079a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:39.881642 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1340/2699] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:39.892082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:39.893636 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:39.954182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0501589c-16c0-4163-a991-806e5dbdf776 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:39.958095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d7ff1-4a17-425e-a694-6be2a685ec6e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:39.958747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d7ff1-4a17-425e-a694-6be2a685ec6e service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:39.959059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d7ff1-4a17-425e-a694-6be2a685ec6e service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:39.959327 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250d7ff1-4a17-425e-a694-6be2a685ec6e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:39.969914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d7ff1-4a17-425e-a694-6be2a685ec6e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:39.970929 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250d7ff1-4a17-425e-a694-6be2a685ec6e service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:39.981087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1360/2700] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:40.268215 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45e18d-b35e-4e2c-a150-61a0416079a6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:40.269742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0a45e18d-b35e-4e2c-a150-61a0416079a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:40.282613 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a45e18d-b35e-4e2c-a150-61a0416079a6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:40.288067 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:40.288764 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:40.289042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:40.289314 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] PATH_INFO: `/v3/projects/f5c455722c00497888fed52ec9851879` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:40.290550 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c455722c00497888fed52ec9851879)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:40.292885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:40.352586 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:40.363224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c455722c00497888fed52ec9851879', 'request_id': 'req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.371701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c455722c00497888fed52ec9851879', 'request_id': 'req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.379058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c455722c00497888fed52ec9851879', 'request_id': 'req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.391154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] The token cache is being invalidate because project f5c455722c00497888fed52ec9851879 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:40.391443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.392190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.393840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1341/2701] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:40 2022] DELETE /identity/v3/projects/f5c455722c00497888fed52ec9851879 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:40.398533 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d7ff1-4a17-425e-a694-6be2a685ec6e service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:40.408719 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250d7ff1-4a17-425e-a694-6be2a685ec6e service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:40.441027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:40.472574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:40.473219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:40.473490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:40.473767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] PATH_INFO: `/v3/users/d3818716f1af4b6391bb845a97d580d0` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:40.474926 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3818716f1af4b6391bb845a97d580d0)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:40.476939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:40.530199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3818716f1af4b6391bb845a97d580d0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.542227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3818716f1af4b6391bb845a97d580d0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.550812 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3818716f1af4b6391bb845a97d580d0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.558733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3818716f1af4b6391bb845a97d580d0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.559487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ee7fd5ab-80aa-43c6-babc-86394a2d0c4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3818716f1af4b6391bb845a97d580d0'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.565709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1361/2702] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:40 2022] DELETE /identity/v3/users/d3818716f1af4b6391bb845a97d580d0 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:40.851746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:40.853436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:40.866945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84feb58e-cc1d-4864-82b3-2b4a5e0bcc0b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:40.929168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:40.929801 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:40.930077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:40.930347 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] PATH_INFO: `/v3/projects/cdd8d62c53b942bd8886dda938bd6605` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:40.931782 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd8d62c53b942bd8886dda938bd6605)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:40.933683 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:40.982584 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd8d62c53b942bd8886dda938bd6605', 'request_id': 'req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:40.992212 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd8d62c53b942bd8886dda938bd6605', 'request_id': 'req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:41.000721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd8d62c53b942bd8886dda938bd6605', 'request_id': 'req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:41.011817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] The token cache is being invalidate because project cdd8d62c53b942bd8886dda938bd6605 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:41.012099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:41.012735 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b76a36d6-3a4c-47e8-b15a-1535eed14aaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:41.014224 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1342/2703] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:40 2022] DELETE /identity/v3/projects/cdd8d62c53b942bd8886dda938bd6605 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:41.019684 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ca4b1-3c57-40b3-a2fc-5e137a4140b5 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.019976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ca4b1-3c57-40b3-a2fc-5e137a4140b5 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.020254 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530ca4b1-3c57-40b3-a2fc-5e137a4140b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.041159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-530ca4b1-3c57-40b3-a2fc-5e137a4140b5 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:41.042377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-530ca4b1-3c57-40b3-a2fc-5e137a4140b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:41.105692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1362/2704] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:41.113696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a897e02-1f71-40d2-9e23-29e8443fc273 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.113984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a897e02-1f71-40d2-9e23-29e8443fc273 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.114255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a897e02-1f71-40d2-9e23-29e8443fc273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.135660 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5a897e02-1f71-40d2-9e23-29e8443fc273 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:41.136880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5a897e02-1f71-40d2-9e23-29e8443fc273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:41.146299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1343/2705] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:41.151570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ca4b1-3c57-40b3-a2fc-5e137a4140b5 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.165029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530ca4b1-3c57-40b3-a2fc-5e137a4140b5 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.168884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62317b9-1857-4047-b94a-9921105064e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.169524 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62317b9-1857-4047-b94a-9921105064e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.169802 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62317b9-1857-4047-b94a-9921105064e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.170068 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62317b9-1857-4047-b94a-9921105064e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.170754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62317b9-1857-4047-b94a-9921105064e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:41.171038 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62317b9-1857-4047-b94a-9921105064e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.172642 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62317b9-1857-4047-b94a-9921105064e2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.185317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1363/2706] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:14:41.190120 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a897e02-1f71-40d2-9e23-29e8443fc273 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.200614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a897e02-1f71-40d2-9e23-29e8443fc273 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.205595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e37039-7b11-4705-8f82-fe9152c64136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.206145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e37039-7b11-4705-8f82-fe9152c64136 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.206421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e37039-7b11-4705-8f82-fe9152c64136 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.206689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e37039-7b11-4705-8f82-fe9152c64136 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.207438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e37039-7b11-4705-8f82-fe9152c64136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.209260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e37039-7b11-4705-8f82-fe9152c64136 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.239779 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1344/2707] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:41 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:41.244670 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62317b9-1857-4047-b94a-9921105064e2 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.255012 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62317b9-1857-4047-b94a-9921105064e2 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.258430 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e37039-7b11-4705-8f82-fe9152c64136 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.260297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-83e37039-7b11-4705-8f82-fe9152c64136 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:41.298127 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:41.301631 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:41.324931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baa140-f974-4561-9a93-10275f4ed90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.326196 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baa140-f974-4561-9a93-10275f4ed90f admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.326196 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baa140-f974-4561-9a93-10275f4ed90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.326196 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66baa140-f974-4561-9a93-10275f4ed90f admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.326828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66baa140-f974-4561-9a93-10275f4ed90f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.328789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66baa140-f974-4561-9a93-10275f4ed90f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.333615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e37039-7b11-4705-8f82-fe9152c64136 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.338881 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.339514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.339787 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.340048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] PATH_INFO: `/v3/users/a66dbb7280a044248ff35760150e028a` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.341287 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a66dbb7280a044248ff35760150e028a)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.343262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.351294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1364/2708] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:41 2022] POST /identity/v3/users => generated 292 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:41.355723 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baa140-f974-4561-9a93-10275f4ed90f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.365179 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66baa140-f974-4561-9a93-10275f4ed90f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.370207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be69c50-340e-4849-880e-98c24a7a663c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.370824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be69c50-340e-4849-880e-98c24a7a663c admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.371100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be69c50-340e-4849-880e-98c24a7a663c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.371365 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be69c50-340e-4849-880e-98c24a7a663c admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.371998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be69c50-340e-4849-880e-98c24a7a663c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.373598 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be69c50-340e-4849-880e-98c24a7a663c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.385207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1365/2709] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:41.389069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be69c50-340e-4849-880e-98c24a7a663c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.397417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a66dbb7280a044248ff35760150e028a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:41.398089 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a66dbb7280a044248ff35760150e028a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:41.398709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a66dbb7280a044248ff35760150e028a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:41.398996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be69c50-340e-4849-880e-98c24a7a663c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.403592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c832c-f2a1-47ea-a6e1-5d5ada213d6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.404182 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c832c-f2a1-47ea-a6e1-5d5ada213d6a admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.404455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c832c-f2a1-47ea-a6e1-5d5ada213d6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.404728 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1c832c-f2a1-47ea-a6e1-5d5ada213d6a admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.405359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c832c-f2a1-47ea-a6e1-5d5ada213d6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.406977 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1c832c-f2a1-47ea-a6e1-5d5ada213d6a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.411060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a66dbb7280a044248ff35760150e028a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:41.417036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1366/2710] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:41.421391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-135118bf-b9da-4462-8168-e0cfe5c5e4f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a66dbb7280a044248ff35760150e028a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:41.421685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c832c-f2a1-47ea-a6e1-5d5ada213d6a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.423894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-6a1c832c-f2a1-47ea-a6e1-5d5ada213d6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:41.435391 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1345/2711] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:41 2022] DELETE /identity/v3/users/a66dbb7280a044248ff35760150e028a => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:41.439498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542b34-b83e-431e-8ede-9cc41de42bb3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.439669 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1c832c-f2a1-47ea-a6e1-5d5ada213d6a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.439775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542b34-b83e-431e-8ede-9cc41de42bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.440066 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99542b34-b83e-431e-8ede-9cc41de42bb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.458962 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-99542b34-b83e-431e-8ede-9cc41de42bb3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:41.460168 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-99542b34-b83e-431e-8ede-9cc41de42bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:41.500574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed1d1b4-d7ee-4bec-af8b-d13d2c3281d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.501478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1d1b4-d7ee-4bec-af8b-d13d2c3281d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.501835 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1d1b4-d7ee-4bec-af8b-d13d2c3281d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.502185 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed1d1b4-d7ee-4bec-af8b-d13d2c3281d4 admin admin] PATH_INFO: `/v3/projects/dff8e75c8789408ba9e2a08c32af1141/users/11339078f3aa46138fa66aed5e3a77c0/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.517507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1d1b4-d7ee-4bec-af8b-d13d2c3281d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dff8e75c8789408ba9e2a08c32af1141, user_id=11339078f3aa46138fa66aed5e3a77c0, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.518885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1346/2712] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:41.520697 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed1d1b4-d7ee-4bec-af8b-d13d2c3281d4 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.529049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542b34-b83e-431e-8ede-9cc41de42bb3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.530454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-99542b34-b83e-431e-8ede-9cc41de42bb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:41.536757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1367/2713] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:41 2022] PUT /identity/v3/projects/dff8e75c8789408ba9e2a08c32af1141/users/11339078f3aa46138fa66aed5e3a77c0/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:41.548762 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde936d-4c10-448c-90fe-41f36dd3f51a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.549039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde936d-4c10-448c-90fe-41f36dd3f51a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.549303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cde936d-4c10-448c-90fe-41f36dd3f51a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.581015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-1cde936d-4c10-448c-90fe-41f36dd3f51a None None] MFA Rules not processed for user `11339078f3aa46138fa66aed5e3a77c0`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:41.582223 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-1cde936d-4c10-448c-90fe-41f36dd3f51a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:41.591161 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99542b34-b83e-431e-8ede-9cc41de42bb3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.595029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:41.642656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3c00e-a07a-4e7d-95ca-4f879bad5110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.643303 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3c00e-a07a-4e7d-95ca-4f879bad5110 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.643576 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3c00e-a07a-4e7d-95ca-4f879bad5110 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.643844 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada3c00e-a07a-4e7d-95ca-4f879bad5110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.647486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1368/2714] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:41.651975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde936d-4c10-448c-90fe-41f36dd3f51a None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.670855 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:41.709220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3c00e-a07a-4e7d-95ca-4f879bad5110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.710590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada3c00e-a07a-4e7d-95ca-4f879bad5110 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.715914 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cde936d-4c10-448c-90fe-41f36dd3f51a None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.723009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c2f91-f180-4fa7-b933-e5cfdf0af300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.723639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c2f91-f180-4fa7-b933-e5cfdf0af300 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.723760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1347/2715] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:14:41.723918 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c2f91-f180-4fa7-b933-e5cfdf0af300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.724191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9c2f91-f180-4fa7-b933-e5cfdf0af300 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.724825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c2f91-f180-4fa7-b933-e5cfdf0af300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.726752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9c2f91-f180-4fa7-b933-e5cfdf0af300 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.759506 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1369/2716] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:41 2022] POST /identity/v3/projects => generated 385 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:41.761121 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3c00e-a07a-4e7d-95ca-4f879bad5110 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.774037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada3c00e-a07a-4e7d-95ca-4f879bad5110 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.837695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8935a-40fb-4ec1-b3b3-d51e94ce5ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.838525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8935a-40fb-4ec1-b3b3-d51e94ce5ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.838913 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8935a-40fb-4ec1-b3b3-d51e94ce5ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.839253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc8935a-40fb-4ec1-b3b3-d51e94ce5ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.839954 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8935a-40fb-4ec1-b3b3-d51e94ce5ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.841890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc8935a-40fb-4ec1-b3b3-d51e94ce5ee9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.869898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1348/2717] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:41 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:41.871310 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c2f91-f180-4fa7-b933-e5cfdf0af300 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.882388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9c2f91-f180-4fa7-b933-e5cfdf0af300 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.888067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c90f2-85ac-471c-b5c2-56895071f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.888594 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c90f2-85ac-471c-b5c2-56895071f525 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.889106 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c90f2-85ac-471c-b5c2-56895071f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.889347 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21c90f2-85ac-471c-b5c2-56895071f525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.890090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c90f2-85ac-471c-b5c2-56895071f525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.904687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21c90f2-85ac-471c-b5c2-56895071f525 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.916306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1370/2718] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:41.920568 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8935a-40fb-4ec1-b3b3-d51e94ce5ee9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.931824 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc8935a-40fb-4ec1-b3b3-d51e94ce5ee9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.937357 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39941d-579f-4585-9a46-0539245ca266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.937970 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39941d-579f-4585-9a46-0539245ca266 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.938255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39941d-579f-4585-9a46-0539245ca266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.938527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39941d-579f-4585-9a46-0539245ca266 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.939232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39941d-579f-4585-9a46-0539245ca266 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.940849 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39941d-579f-4585-9a46-0539245ca266 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:41.953457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1349/2719] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:41.957810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c90f2-85ac-471c-b5c2-56895071f525 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:41.968901 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21c90f2-85ac-471c-b5c2-56895071f525 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:41.974055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e068bb-da73-4593-a72b-88aefbc1a27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:41.974724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e068bb-da73-4593-a72b-88aefbc1a27b admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:41.975036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e068bb-da73-4593-a72b-88aefbc1a27b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:41.975303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e068bb-da73-4593-a72b-88aefbc1a27b admin admin] PATH_INFO: `/v3/projects/6fa06187687441acacb0a5ca783f39e2/users/b9e285fdf47f40f092eae080c02d6fe2/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:41.991285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e068bb-da73-4593-a72b-88aefbc1a27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fa06187687441acacb0a5ca783f39e2, user_id=b9e285fdf47f40f092eae080c02d6fe2, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:41.994389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e068bb-da73-4593-a72b-88aefbc1a27b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.010822 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1371/2720] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:41 2022] PUT /identity/v3/projects/6fa06187687441acacb0a5ca783f39e2/users/b9e285fdf47f40f092eae080c02d6fe2/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:42.021517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8db1-b352-4f33-bc16-7f0abd5f1914 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.021978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8db1-b352-4f33-bc16-7f0abd5f1914 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.022337 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747b8db1-b352-4f33-bc16-7f0abd5f1914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.035231 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e068bb-da73-4593-a72b-88aefbc1a27b admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:42.037437 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d4e068bb-da73-4593-a72b-88aefbc1a27b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:42.071127 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-747b8db1-b352-4f33-bc16-7f0abd5f1914 None None] MFA Rules not processed for user `b9e285fdf47f40f092eae080c02d6fe2`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:42.072637 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-747b8db1-b352-4f33-bc16-7f0abd5f1914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:42.099225 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:42.126224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e068bb-da73-4593-a72b-88aefbc1a27b admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:42.130971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:42.131612 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.131888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.132156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] PATH_INFO: `/v3/projects/aac4028a418844bcbfe6699082078e8a` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.133251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aac4028a418844bcbfe6699082078e8a)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:42.135880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.147145 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1350/2721] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:42.150566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b8db1-b352-4f33-bc16-7f0abd5f1914 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:42.161749 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747b8db1-b352-4f33-bc16-7f0abd5f1914 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:42.166921 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9879a-6ff5-49bf-bda8-d49c4f7ab517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:42.167544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9879a-6ff5-49bf-bda8-d49c4f7ab517 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.167821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9879a-6ff5-49bf-bda8-d49c4f7ab517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.168241 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c9879a-6ff5-49bf-bda8-d49c4f7ab517 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.168892 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9879a-6ff5-49bf-bda8-d49c4f7ab517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:42.170965 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c9879a-6ff5-49bf-bda8-d49c4f7ab517 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.192359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aac4028a418844bcbfe6699082078e8a', 'request_id': 'req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.199982 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aac4028a418844bcbfe6699082078e8a', 'request_id': 'req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.205521 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1351/2722] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:42 2022] POST /identity/v3/projects => generated 383 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:42.209623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9879a-6ff5-49bf-bda8-d49c4f7ab517 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:42.210232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aac4028a418844bcbfe6699082078e8a', 'request_id': 'req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.222157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] The token cache is being invalidate because project aac4028a418844bcbfe6699082078e8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:42.222469 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.223091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:42.223683 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.226417 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1372/2723] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:42 2022] DELETE /identity/v3/projects/aac4028a418844bcbfe6699082078e8a => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:42.231232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:42.232824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:42.281155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c9879a-6ff5-49bf-bda8-d49c4f7ab517 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:42.286405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21ee42-b4df-4cc1-80be-cc5e1e660421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:42.287038 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21ee42-b4df-4cc1-80be-cc5e1e660421 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.287312 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21ee42-b4df-4cc1-80be-cc5e1e660421 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.287585 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21ee42-b4df-4cc1-80be-cc5e1e660421 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.288230 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21ee42-b4df-4cc1-80be-cc5e1e660421 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:42.290253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c21ee42-b4df-4cc1-80be-cc5e1e660421 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.300067 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72a3611-c683-4cae-a9f1-dd8c5d73cbe3 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:42.307027 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:42.307834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.308113 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.308513 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] PATH_INFO: `/v3/users/7b641ec286a345d8acddba6e3aeb34bb` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.309706 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b641ec286a345d8acddba6e3aeb34bb)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:42.311696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.313326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1352/2724] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:42 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:42.317220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21ee42-b4df-4cc1-80be-cc5e1e660421 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:42.319065 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7c21ee42-b4df-4cc1-80be-cc5e1e660421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:42.331600 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21ee42-b4df-4cc1-80be-cc5e1e660421 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:42.336213 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8156b-d65c-40ff-b4f1-845478c78797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:42.336817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8156b-d65c-40ff-b4f1-845478c78797 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.337141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8156b-d65c-40ff-b4f1-845478c78797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.337412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8156b-d65c-40ff-b4f1-845478c78797 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.338062 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8156b-d65c-40ff-b4f1-845478c78797 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:42.339718 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d8156b-d65c-40ff-b4f1-845478c78797 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.351176 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1353/2725] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:42.355771 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8156b-d65c-40ff-b4f1-845478c78797 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:42.366327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8156b-d65c-40ff-b4f1-845478c78797 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:42.368592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b641ec286a345d8acddba6e3aeb34bb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.371385 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1b59-b9c4-4e90-89ab-a921eb4c4ec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:42.372032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1b59-b9c4-4e90-89ab-a921eb4c4ec7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.372310 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1b59-b9c4-4e90-89ab-a921eb4c4ec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.372570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21a1b59-b9c4-4e90-89ab-a921eb4c4ec7 admin admin] PATH_INFO: `/v3/projects/f94967eda48a4e3eac1a4709fc13931a/users/89ffec30d1164ecd8a5a13abf35e7c13/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.380814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b641ec286a345d8acddba6e3aeb34bb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.388879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a1b59-b9c4-4e90-89ab-a921eb4c4ec7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94967eda48a4e3eac1a4709fc13931a, user_id=89ffec30d1164ecd8a5a13abf35e7c13, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:42.390565 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b641ec286a345d8acddba6e3aeb34bb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.392112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21a1b59-b9c4-4e90-89ab-a921eb4c4ec7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.399724 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b641ec286a345d8acddba6e3aeb34bb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.400539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b641ec286a345d8acddba6e3aeb34bb'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.406788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1354/2726] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:42 2022] PUT /identity/v3/projects/f94967eda48a4e3eac1a4709fc13931a/users/89ffec30d1164ecd8a5a13abf35e7c13/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:42.406996 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1373/2727] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:42 2022] DELETE /identity/v3/users/7b641ec286a345d8acddba6e3aeb34bb => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:42.410972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1b59-b9c4-4e90-89ab-a921eb4c4ec7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:42.412608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b21a1b59-b9c4-4e90-89ab-a921eb4c4ec7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:42.476389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:42.481977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21a1b59-b9c4-4e90-89ab-a921eb4c4ec7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:42.547378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd3448-3566-482b-a2be-86601bc73330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:42.548193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd3448-3566-482b-a2be-86601bc73330 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.548464 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd3448-3566-482b-a2be-86601bc73330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.548729 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd3448-3566-482b-a2be-86601bc73330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.549388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd3448-3566-482b-a2be-86601bc73330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:42.551045 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd3448-3566-482b-a2be-86601bc73330 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.563562 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1355/2728] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:42 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:42.567888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:42.579147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977f041b-bf31-4d91-a651-5623b506d8b9 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:42.584391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df6b77-3d69-41d5-bbd2-086258e7a505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:42.585069 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df6b77-3d69-41d5-bbd2-086258e7a505 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.585436 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df6b77-3d69-41d5-bbd2-086258e7a505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.585688 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76df6b77-3d69-41d5-bbd2-086258e7a505 admin admin] PATH_INFO: `/v3/projects/f94967eda48a4e3eac1a4709fc13931a/users/89ffec30d1164ecd8a5a13abf35e7c13/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.587949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df6b77-3d69-41d5-bbd2-086258e7a505 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f94967eda48a4e3eac1a4709fc13931a, user_id=89ffec30d1164ecd8a5a13abf35e7c13, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:42.590593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76df6b77-3d69-41d5-bbd2-086258e7a505 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.612733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bb41e-96d8-43e0-9fbf-a0b960bc63fe None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.613056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bb41e-96d8-43e0-9fbf-a0b960bc63fe None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.613414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38bb41e-96d8-43e0-9fbf-a0b960bc63fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.614846 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1374/2729] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:42 2022] PUT /identity/v3/projects/f94967eda48a4e3eac1a4709fc13931a/users/89ffec30d1164ecd8a5a13abf35e7c13/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:42.648595 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-b38bb41e-96d8-43e0-9fbf-a0b960bc63fe None None] MFA Rules not processed for user `89ffec30d1164ecd8a5a13abf35e7c13`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:42.650621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b38bb41e-96d8-43e0-9fbf-a0b960bc63fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:42.719732 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df6b77-3d69-41d5-bbd2-086258e7a505 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:42.721495 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-76df6b77-3d69-41d5-bbd2-086258e7a505 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:42.740918 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1356/2730] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:42.753932 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bb41e-96d8-43e0-9fbf-a0b960bc63fe None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:42.761459 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b38bb41e-96d8-43e0-9fbf-a0b960bc63fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:42.806805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76df6b77-3d69-41d5-bbd2-086258e7a505 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:42.811637 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:42.812350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.812626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.812889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] PATH_INFO: `/v3/projects/0e1efcea00b04f25bee838ea4224853d` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.814152 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e1efcea00b04f25bee838ea4224853d)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:42.816232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.823260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:42.845151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38bb41e-96d8-43e0-9fbf-a0b960bc63fe None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:42.849846 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3971d34a-869f-43bf-b632-10a9bb00038a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:42.850577 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d34a-869f-43bf-b632-10a9bb00038a service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.850948 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d34a-869f-43bf-b632-10a9bb00038a service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.851258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3971d34a-869f-43bf-b632-10a9bb00038a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.853760 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3971d34a-869f-43bf-b632-10a9bb00038a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:42.871877 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e1efcea00b04f25bee838ea4224853d', 'request_id': 'req-367bb439-5c87-4968-8abe-1851cf1a038e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.877246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e1efcea00b04f25bee838ea4224853d', 'request_id': 'req-367bb439-5c87-4968-8abe-1851cf1a038e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.886319 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e1efcea00b04f25bee838ea4224853d', 'request_id': 'req-367bb439-5c87-4968-8abe-1851cf1a038e'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.898487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] The token cache is being invalidate because project 0e1efcea00b04f25bee838ea4224853d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:42.898899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.899626 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=100 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:42.900085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-367bb439-5c87-4968-8abe-1851cf1a038e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:42.905264 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1375/2731] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:42 2022] DELETE /identity/v3/projects/0e1efcea00b04f25bee838ea4224853d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:42.906674 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4c1c-3c27-473f-8979-de3cdd14820b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:42.907034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4c1c-3c27-473f-8979-de3cdd14820b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:42.907303 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb4c1c-3c27-473f-8979-de3cdd14820b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:42.918479 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971d34a-869f-43bf-b632-10a9bb00038a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:42.920012 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3971d34a-869f-43bf-b632-10a9bb00038a service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:42.926796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-61eb4c1c-3c27-473f-8979-de3cdd14820b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:42.927997 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-61eb4c1c-3c27-473f-8979-de3cdd14820b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:42.929015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1357/2732] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:42 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:42.998270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1376/2733] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:43.006135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06bba0-e1bf-49e0-8aa4-0f5a2eb17b02 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.006418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06bba0-e1bf-49e0-8aa4-0f5a2eb17b02 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.006693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb06bba0-e1bf-49e0-8aa4-0f5a2eb17b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.029427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-fb06bba0-e1bf-49e0-8aa4-0f5a2eb17b02 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:43.030651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-fb06bba0-e1bf-49e0-8aa4-0f5a2eb17b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:43.040193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1358/2734] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:43.045506 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb4c1c-3c27-473f-8979-de3cdd14820b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.060160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb4c1c-3c27-473f-8979-de3cdd14820b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.067186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e5ed3-4dcf-4cde-b5ee-5001dfda712e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.067939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e5ed3-4dcf-4cde-b5ee-5001dfda712e admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.068220 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e5ed3-4dcf-4cde-b5ee-5001dfda712e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.068498 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e5ed3-4dcf-4cde-b5ee-5001dfda712e admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.069159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e5ed3-4dcf-4cde-b5ee-5001dfda712e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:43.069453 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e5ed3-4dcf-4cde-b5ee-5001dfda712e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.071115 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e5ed3-4dcf-4cde-b5ee-5001dfda712e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.090648 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1377/2735] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:14:43.095489 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06bba0-e1bf-49e0-8aa4-0f5a2eb17b02 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.105815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb06bba0-e1bf-49e0-8aa4-0f5a2eb17b02 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.114901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177917c-c012-43aa-80c9-3e329de90a85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.115551 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177917c-c012-43aa-80c9-3e329de90a85 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.116185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177917c-c012-43aa-80c9-3e329de90a85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.116513 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a177917c-c012-43aa-80c9-3e329de90a85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.117102 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177917c-c012-43aa-80c9-3e329de90a85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.119318 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a177917c-c012-43aa-80c9-3e329de90a85 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.158395 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e5ed3-4dcf-4cde-b5ee-5001dfda712e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.162924 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1359/2736] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:43 2022] POST /identity/v3/projects => generated 381 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:43.170959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e5ed3-4dcf-4cde-b5ee-5001dfda712e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.282424 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffa802-0bd4-4eb9-a002-c710ae8fb033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.283541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffa802-0bd4-4eb9-a002-c710ae8fb033 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.283921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffa802-0bd4-4eb9-a002-c710ae8fb033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.284428 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ffa802-0bd4-4eb9-a002-c710ae8fb033 admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.285677 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffa802-0bd4-4eb9-a002-c710ae8fb033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.288539 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ffa802-0bd4-4eb9-a002-c710ae8fb033 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.324895 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1378/2737] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:43 2022] POST /identity/v3/users => generated 291 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:43.329767 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177917c-c012-43aa-80c9-3e329de90a85 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.341543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a177917c-c012-43aa-80c9-3e329de90a85 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.346456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301b3b2-e8fd-4ce2-bcf8-73425963e60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.347172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b3b2-e8fd-4ce2-bcf8-73425963e60d admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.347519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b3b2-e8fd-4ce2-bcf8-73425963e60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.347858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c301b3b2-e8fd-4ce2-bcf8-73425963e60d admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.348588 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301b3b2-e8fd-4ce2-bcf8-73425963e60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.350299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c301b3b2-e8fd-4ce2-bcf8-73425963e60d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.362633 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1360/2738] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:43.366826 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffa802-0bd4-4eb9-a002-c710ae8fb033 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.378093 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ffa802-0bd4-4eb9-a002-c710ae8fb033 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.382971 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b45ba-9741-4a70-b084-4ff3d58b7e37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.383657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b45ba-9741-4a70-b084-4ff3d58b7e37 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.384070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b45ba-9741-4a70-b084-4ff3d58b7e37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.384961 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b45ba-9741-4a70-b084-4ff3d58b7e37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.385721 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b45ba-9741-4a70-b084-4ff3d58b7e37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.387561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b45ba-9741-4a70-b084-4ff3d58b7e37 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.394622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:43.406654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1379/2739] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:43.407721 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301b3b2-e8fd-4ce2-bcf8-73425963e60d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.420059 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c301b3b2-e8fd-4ce2-bcf8-73425963e60d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.425044 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5be01-77a1-49b1-b197-a68f4060090b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.425695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5be01-77a1-49b1-b197-a68f4060090b admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.425974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5be01-77a1-49b1-b197-a68f4060090b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.426251 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a5be01-77a1-49b1-b197-a68f4060090b admin admin] PATH_INFO: `/v3/projects/d3f5c4c4991f4cb09bf2cb136772bc21/users/4f1b63bc449041c8b325c902bb505af3/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.440742 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5be01-77a1-49b1-b197-a68f4060090b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f5c4c4991f4cb09bf2cb136772bc21, user_id=4f1b63bc449041c8b325c902bb505af3, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.443469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a5be01-77a1-49b1-b197-a68f4060090b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.457874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1361/2740] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:43 2022] PUT /identity/v3/projects/d3f5c4c4991f4cb09bf2cb136772bc21/users/4f1b63bc449041c8b325c902bb505af3/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:43.469200 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28622b68-05df-4e9f-984d-22d75ca78c37 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.469570 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28622b68-05df-4e9f-984d-22d75ca78c37 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.469908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28622b68-05df-4e9f-984d-22d75ca78c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.506339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-28622b68-05df-4e9f-984d-22d75ca78c37 None None] MFA Rules not processed for user `4f1b63bc449041c8b325c902bb505af3`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:43.507517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-28622b68-05df-4e9f-984d-22d75ca78c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:43.576085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1380/2741] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:43.582639 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5be01-77a1-49b1-b197-a68f4060090b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.647454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a5be01-77a1-49b1-b197-a68f4060090b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.652745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1e3d2-8a01-41a8-a157-13a95c711c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.653342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e3d2-8a01-41a8-a157-13a95c711c69 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.653623 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e3d2-8a01-41a8-a157-13a95c711c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.653894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1e3d2-8a01-41a8-a157-13a95c711c69 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.654516 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1e3d2-8a01-41a8-a157-13a95c711c69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.656465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1e3d2-8a01-41a8-a157-13a95c711c69 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.691973 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1362/2742] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:43 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:43.697550 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28622b68-05df-4e9f-984d-22d75ca78c37 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.709999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28622b68-05df-4e9f-984d-22d75ca78c37 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.768070 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f112fd-762e-4967-8fc4-ab8dfe6f408b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.768610 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f112fd-762e-4967-8fc4-ab8dfe6f408b admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.768973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f112fd-762e-4967-8fc4-ab8dfe6f408b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.769246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f112fd-762e-4967-8fc4-ab8dfe6f408b admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.769903 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f112fd-762e-4967-8fc4-ab8dfe6f408b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.771844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f112fd-762e-4967-8fc4-ab8dfe6f408b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.795603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1381/2743] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:43 2022] POST /identity/v3/users => generated 298 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:43.799943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1e3d2-8a01-41a8-a157-13a95c711c69 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.810580 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1e3d2-8a01-41a8-a157-13a95c711c69 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.815487 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07889-d7bd-4ab2-801b-01e963d2e498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.816106 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07889-d7bd-4ab2-801b-01e963d2e498 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.816384 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07889-d7bd-4ab2-801b-01e963d2e498 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.816651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b07889-d7bd-4ab2-801b-01e963d2e498 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.817301 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b07889-d7bd-4ab2-801b-01e963d2e498 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.818931 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b07889-d7bd-4ab2-801b-01e963d2e498 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.829947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1363/2744] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:43.834245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f112fd-762e-4967-8fc4-ab8dfe6f408b admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.845051 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f112fd-762e-4967-8fc4-ab8dfe6f408b admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.851046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e436df-dcd8-4ba8-bce1-73e597e0c827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.851705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e436df-dcd8-4ba8-bce1-73e597e0c827 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.851985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e436df-dcd8-4ba8-bce1-73e597e0c827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.852255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e436df-dcd8-4ba8-bce1-73e597e0c827 admin admin] PATH_INFO: `/v3/projects/39d900a49c094686ad385890d5ea6216/users/e78f61b5ca06475580cbc9be690d042d/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.868121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e436df-dcd8-4ba8-bce1-73e597e0c827 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d900a49c094686ad385890d5ea6216, user_id=e78f61b5ca06475580cbc9be690d042d, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.870855 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e436df-dcd8-4ba8-bce1-73e597e0c827 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.888204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1382/2745] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:43 2022] PUT /identity/v3/projects/39d900a49c094686ad385890d5ea6216/users/e78f61b5ca06475580cbc9be690d042d/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:43.895373 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07889-d7bd-4ab2-801b-01e963d2e498 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:43.907624 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b07889-d7bd-4ab2-801b-01e963d2e498 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:43.964240 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:43.976372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91003c6-5133-4af9-bd98-044da955fa50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:43.976981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91003c6-5133-4af9-bd98-044da955fa50 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:43.977281 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91003c6-5133-4af9-bd98-044da955fa50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:43.977725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91003c6-5133-4af9-bd98-044da955fa50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:43.979818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91003c6-5133-4af9-bd98-044da955fa50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:43.981448 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91003c6-5133-4af9-bd98-044da955fa50 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:43.991458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1364/2746] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:43 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:43.996433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e436df-dcd8-4ba8-bce1-73e597e0c827 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:44.007290 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e436df-dcd8-4ba8-bce1-73e597e0c827 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:44.012844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f17b23-979f-43aa-adcd-fcf63c86fe0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:44.013505 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f17b23-979f-43aa-adcd-fcf63c86fe0a admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:44.013784 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f17b23-979f-43aa-adcd-fcf63c86fe0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:44.014052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f17b23-979f-43aa-adcd-fcf63c86fe0a admin admin] PATH_INFO: `/v3/projects/39d900a49c094686ad385890d5ea6216/users/e78f61b5ca06475580cbc9be690d042d/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:44.016401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f17b23-979f-43aa-adcd-fcf63c86fe0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39d900a49c094686ad385890d5ea6216, user_id=e78f61b5ca06475580cbc9be690d042d, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:44.019167 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f17b23-979f-43aa-adcd-fcf63c86fe0a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:44.030006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1383/2747] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:43 2022] PUT /identity/v3/projects/39d900a49c094686ad385890d5ea6216/users/e78f61b5ca06475580cbc9be690d042d/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:44.042549 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc5f60-57d7-44a8-8fff-54d4f18eac92 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:44.042851 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc5f60-57d7-44a8-8fff-54d4f18eac92 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:44.043208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fc5f60-57d7-44a8-8fff-54d4f18eac92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:44.073100 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-96fc5f60-57d7-44a8-8fff-54d4f18eac92 None None] MFA Rules not processed for user `e78f61b5ca06475580cbc9be690d042d`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:44.074307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-96fc5f60-57d7-44a8-8fff-54d4f18eac92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:44.145472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1365/2748] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:44.158320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f17b23-979f-43aa-adcd-fcf63c86fe0a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:44.160560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-17f17b23-979f-43aa-adcd-fcf63c86fe0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:44.218219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:44.232834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f17b23-979f-43aa-adcd-fcf63c86fe0a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:44.237074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c13f5-586a-4f00-9a75-d9d58f45b034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:44.237685 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c13f5-586a-4f00-9a75-d9d58f45b034 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:44.237963 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c13f5-586a-4f00-9a75-d9d58f45b034 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:44.238237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c13f5-586a-4f00-9a75-d9d58f45b034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:44.248666 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c13f5-586a-4f00-9a75-d9d58f45b034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:44.250099 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c13f5-586a-4f00-9a75-d9d58f45b034 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:44.260064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1384/2749] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:44 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:44.348397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc5f60-57d7-44a8-8fff-54d4f18eac92 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:44.358968 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fc5f60-57d7-44a8-8fff-54d4f18eac92 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:44.362709 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cceda-0063-4258-b2c1-7a5253f82fc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:44.363472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cceda-0063-4258-b2c1-7a5253f82fc9 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:44.363812 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cceda-0063-4258-b2c1-7a5253f82fc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:44.364149 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47cceda-0063-4258-b2c1-7a5253f82fc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:44.423037 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cceda-0063-4258-b2c1-7a5253f82fc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:44.424610 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47cceda-0063-4258-b2c1-7a5253f82fc9 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:44.435546 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1366/2750] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:44 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:44.482603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c13f5-586a-4f00-9a75-d9d58f45b034 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:44.484142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-732c13f5-586a-4f00-9a75-d9d58f45b034 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:44.496560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c13f5-586a-4f00-9a75-d9d58f45b034 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:44.501766 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0169a21-42ec-41b4-a99c-6130795a5bea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:44.502512 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169a21-42ec-41b4-a99c-6130795a5bea service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:44.502701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169a21-42ec-41b4-a99c-6130795a5bea service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:44.502995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0169a21-42ec-41b4-a99c-6130795a5bea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:44.505121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e0169a21-42ec-41b4-a99c-6130795a5bea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:44.592655 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169a21-42ec-41b4-a99c-6130795a5bea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:44.594203 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0169a21-42ec-41b4-a99c-6130795a5bea service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:44.611553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1385/2751] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:44 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:44.757554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cceda-0063-4258-b2c1-7a5253f82fc9 service cinder] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:44.861393 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47cceda-0063-4258-b2c1-7a5253f82fc9 service cinder] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:44.866204 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:44.866864 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:44.867140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:44.867406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] PATH_INFO: `/v3/users/4f1b63bc449041c8b325c902bb505af3` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:44.868737 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1b63bc449041c8b325c902bb505af3)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:44.871118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:44.884336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:44.924063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1b63bc449041c8b325c902bb505af3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:44.924711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1b63bc449041c8b325c902bb505af3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:44.925297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1b63bc449041c8b325c902bb505af3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:44.938307 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1b63bc449041c8b325c902bb505af3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:44.946763 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1b63bc449041c8b325c902bb505af3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:44.963103 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1367/2752] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:44 2022] DELETE /identity/v3/users/4f1b63bc449041c8b325c902bb505af3 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:44.968998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbbca7-6d1a-4ffd-ba1a-77e61d9ffa7b None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:44.969530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbbca7-6d1a-4ffd-ba1a-77e61d9ffa7b None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:44.969618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bbbca7-6d1a-4ffd-ba1a-77e61d9ffa7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:44.996986 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-f3bbbca7-6d1a-4ffd-ba1a-77e61d9ffa7b None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:44.998433 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f3bbbca7-6d1a-4ffd-ba1a-77e61d9ffa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:45.069856 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1386/2753] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:45.080786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:45.082210 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:45.153942 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110871b2-7801-457a-aa5d-75ba224082d6 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:45.158372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f1644-b7ae-4abf-99dc-3df96ab3b340 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:45.159021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f1644-b7ae-4abf-99dc-3df96ab3b340 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:45.159299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f1644-b7ae-4abf-99dc-3df96ab3b340 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:45.159572 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4f1644-b7ae-4abf-99dc-3df96ab3b340 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:45.170536 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f1644-b7ae-4abf-99dc-3df96ab3b340 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:45.172039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4f1644-b7ae-4abf-99dc-3df96ab3b340 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:45.182991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1368/2754] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:45.220470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbbca7-6d1a-4ffd-ba1a-77e61d9ffa7b None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:45.221938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f3bbbca7-6d1a-4ffd-ba1a-77e61d9ffa7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:45.283883 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bbbca7-6d1a-4ffd-ba1a-77e61d9ffa7b None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:45.287810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c610bc-f24d-4308-89a7-b9abb5cab880 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:45.288639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c610bc-f24d-4308-89a7-b9abb5cab880 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:45.288896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c610bc-f24d-4308-89a7-b9abb5cab880 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:45.289204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c610bc-f24d-4308-89a7-b9abb5cab880 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:45.291402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a1c610bc-f24d-4308-89a7-b9abb5cab880 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:45.335270 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=100 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:45.365409 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c610bc-f24d-4308-89a7-b9abb5cab880 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:45.366939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c610bc-f24d-4308-89a7-b9abb5cab880 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:45.377056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1387/2755] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:45 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:45.479375 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f1644-b7ae-4abf-99dc-3df96ab3b340 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:45.480802 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ee4f1644-b7ae-4abf-99dc-3df96ab3b340 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:45.496101 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4f1644-b7ae-4abf-99dc-3df96ab3b340 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:45.501650 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:45.502284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:45.502569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:45.502880 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] PATH_INFO: `/v3/projects/d3f5c4c4991f4cb09bf2cb136772bc21` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:45.504710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f5c4c4991f4cb09bf2cb136772bc21)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:45.506647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:45.560829 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f5c4c4991f4cb09bf2cb136772bc21', 'request_id': 'req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:45.569912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f5c4c4991f4cb09bf2cb136772bc21', 'request_id': 'req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:45.576890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f5c4c4991f4cb09bf2cb136772bc21', 'request_id': 'req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:45.588285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] The token cache is being invalidate because project d3f5c4c4991f4cb09bf2cb136772bc21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:45.588523 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:45.589162 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:45.590915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1369/2756] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:45 2022] DELETE /identity/v3/projects/d3f5c4c4991f4cb09bf2cb136772bc21 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:45.595184 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c610bc-f24d-4308-89a7-b9abb5cab880 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:45.607344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c610bc-f24d-4308-89a7-b9abb5cab880 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:45.676561 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:45.677215 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:45.677497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:45.677765 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] PATH_INFO: `/v3/users/e78f61b5ca06475580cbc9be690d042d` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:45.679752 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e78f61b5ca06475580cbc9be690d042d)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:45.683194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:45.736287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e78f61b5ca06475580cbc9be690d042d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:45.749644 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e78f61b5ca06475580cbc9be690d042d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:45.760668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e78f61b5ca06475580cbc9be690d042d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:45.770197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e78f61b5ca06475580cbc9be690d042d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:45.770974 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-571fe5c7-179e-4e84-823c-04b2b43de3cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e78f61b5ca06475580cbc9be690d042d'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:45.777571 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1388/2757] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:45 2022] DELETE /identity/v3/users/e78f61b5ca06475580cbc9be690d042d => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:46.071756 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:46.073427 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:46.087250 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60ebdbe-9782-4a71-bcb7-095fb9db74e3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:46.101860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:46.149943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:46.150711 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.151022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.151298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] PATH_INFO: `/v3/projects/39d900a49c094686ad385890d5ea6216` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.152593 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39d900a49c094686ad385890d5ea6216)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:46.154614 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:46.206449 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39d900a49c094686ad385890d5ea6216', 'request_id': 'req-9ceff366-eff5-4ee8-a144-1e15db2a4a95'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:46.215535 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39d900a49c094686ad385890d5ea6216', 'request_id': 'req-9ceff366-eff5-4ee8-a144-1e15db2a4a95'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:46.221833 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39d900a49c094686ad385890d5ea6216', 'request_id': 'req-9ceff366-eff5-4ee8-a144-1e15db2a4a95'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:46.232757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] The token cache is being invalidate because project 39d900a49c094686ad385890d5ea6216 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:46.233042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:46.233706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9ceff366-eff5-4ee8-a144-1e15db2a4a95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:46.235254 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1370/2758] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:46 2022] DELETE /identity/v3/projects/39d900a49c094686ad385890d5ea6216 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:46.240251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40414db-0bbb-44a8-9568-d15050c5e203 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.240814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40414db-0bbb-44a8-9568-d15050c5e203 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.240814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40414db-0bbb-44a8-9568-d15050c5e203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.261835 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-c40414db-0bbb-44a8-9568-d15050c5e203 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:46.263079 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c40414db-0bbb-44a8-9568-d15050c5e203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:46.314361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:46.333898 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1389/2759] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:46.342664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd9d0-54c5-4480-a659-18f294c76f2c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.342984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd9d0-54c5-4480-a659-18f294c76f2c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.343255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cd9d0-54c5-4480-a659-18f294c76f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.364270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-128cd9d0-54c5-4480-a659-18f294c76f2c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:46.365478 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-128cd9d0-54c5-4480-a659-18f294c76f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:46.374116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1371/2760] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:46.378468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40414db-0bbb-44a8-9568-d15050c5e203 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:46.388989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40414db-0bbb-44a8-9568-d15050c5e203 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:46.394741 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64594dea-10fb-43e0-aa33-134604b86fc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:46.395378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64594dea-10fb-43e0-aa33-134604b86fc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.395655 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64594dea-10fb-43e0-aa33-134604b86fc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.395925 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64594dea-10fb-43e0-aa33-134604b86fc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.396569 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64594dea-10fb-43e0-aa33-134604b86fc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:46.396869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64594dea-10fb-43e0-aa33-134604b86fc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:46.398497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64594dea-10fb-43e0-aa33-134604b86fc6 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:46.411024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1390/2761] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:14:46.415326 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cd9d0-54c5-4480-a659-18f294c76f2c None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:46.425133 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cd9d0-54c5-4480-a659-18f294c76f2c None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:46.431087 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2877c7-249d-451a-a7e4-cd6a227ad22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:46.431896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2877c7-249d-451a-a7e4-cd6a227ad22d admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.432173 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2877c7-249d-451a-a7e4-cd6a227ad22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.432443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2877c7-249d-451a-a7e4-cd6a227ad22d admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.433064 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2877c7-249d-451a-a7e4-cd6a227ad22d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:46.435048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2877c7-249d-451a-a7e4-cd6a227ad22d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:46.466237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1372/2762] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:46 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:46.470500 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64594dea-10fb-43e0-aa33-134604b86fc6 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:46.481245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64594dea-10fb-43e0-aa33-134604b86fc6 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:46.549888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3891f-32dc-4e40-b1fd-2de0bab290dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:46.550536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3891f-32dc-4e40-b1fd-2de0bab290dc admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.550850 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3891f-32dc-4e40-b1fd-2de0bab290dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.551123 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c3891f-32dc-4e40-b1fd-2de0bab290dc admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.551858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3891f-32dc-4e40-b1fd-2de0bab290dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:46.553792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c3891f-32dc-4e40-b1fd-2de0bab290dc admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:46.576780 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1391/2763] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:46 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:46.581794 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2877c7-249d-451a-a7e4-cd6a227ad22d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:46.598486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2877c7-249d-451a-a7e4-cd6a227ad22d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:46.603977 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79dbb9-04dd-4e82-a3b4-3c2c276821ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:46.604655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79dbb9-04dd-4e82-a3b4-3c2c276821ef admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.604935 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79dbb9-04dd-4e82-a3b4-3c2c276821ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.605203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b79dbb9-04dd-4e82-a3b4-3c2c276821ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.605861 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79dbb9-04dd-4e82-a3b4-3c2c276821ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:46.608208 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b79dbb9-04dd-4e82-a3b4-3c2c276821ef admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:46.620342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1373/2764] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:46.624764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3891f-32dc-4e40-b1fd-2de0bab290dc admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:46.637398 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c3891f-32dc-4e40-b1fd-2de0bab290dc admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:46.642897 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c6657-f01b-45d1-9ea6-25990178a868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:46.643622 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c6657-f01b-45d1-9ea6-25990178a868 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.643972 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c6657-f01b-45d1-9ea6-25990178a868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.644298 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c6657-f01b-45d1-9ea6-25990178a868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.645078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c6657-f01b-45d1-9ea6-25990178a868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:46.647493 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c6657-f01b-45d1-9ea6-25990178a868 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:46.659961 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1392/2765] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:46.664170 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79dbb9-04dd-4e82-a3b4-3c2c276821ef admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:46.674974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b79dbb9-04dd-4e82-a3b4-3c2c276821ef admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:46.680746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ab5d7-5117-4e25-bd10-693e09ac92e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:46.681417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab5d7-5117-4e25-bd10-693e09ac92e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.682001 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab5d7-5117-4e25-bd10-693e09ac92e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.682273 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156ab5d7-5117-4e25-bd10-693e09ac92e3 admin admin] PATH_INFO: `/v3/projects/3f15d9b766f04cb68fff34c8904a1131/users/270ed994e77540b9bfd8129bf2f1ef1a/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.701710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ab5d7-5117-4e25-bd10-693e09ac92e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f15d9b766f04cb68fff34c8904a1131, user_id=270ed994e77540b9bfd8129bf2f1ef1a, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:46.704465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156ab5d7-5117-4e25-bd10-693e09ac92e3 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:46.719460 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1374/2766] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:46 2022] PUT /identity/v3/projects/3f15d9b766f04cb68fff34c8904a1131/users/270ed994e77540b9bfd8129bf2f1ef1a/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:46.733789 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e88a-699e-4a82-8808-e635e06a96f9 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.734178 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e88a-699e-4a82-8808-e635e06a96f9 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.734587 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96e88a-699e-4a82-8808-e635e06a96f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.781491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-bb96e88a-699e-4a82-8808-e635e06a96f9 None None] MFA Rules not processed for user `270ed994e77540b9bfd8129bf2f1ef1a`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:46.782719 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-bb96e88a-699e-4a82-8808-e635e06a96f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:46.858126 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1393/2767] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:46.862971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ab5d7-5117-4e25-bd10-693e09ac92e3 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:46.917158 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:46.937867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156ab5d7-5117-4e25-bd10-693e09ac92e3 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:46.943010 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6098a58-0aa5-4a64-98e0-8bef49180c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:46.943666 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6098a58-0aa5-4a64-98e0-8bef49180c93 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:46.943945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6098a58-0aa5-4a64-98e0-8bef49180c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:46.944217 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6098a58-0aa5-4a64-98e0-8bef49180c93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:46.944974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6098a58-0aa5-4a64-98e0-8bef49180c93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:46.947243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6098a58-0aa5-4a64-98e0-8bef49180c93 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:46.976116 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1375/2768] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:46 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:14:46.980357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e88a-699e-4a82-8808-e635e06a96f9 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:46.991277 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96e88a-699e-4a82-8808-e635e06a96f9 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:47.040306 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:47.053439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98b4d-dfac-480f-bae6-5aa3f0b1906b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:47.054055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98b4d-dfac-480f-bae6-5aa3f0b1906b admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:47.054338 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98b4d-dfac-480f-bae6-5aa3f0b1906b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:47.054603 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f98b4d-dfac-480f-bae6-5aa3f0b1906b admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:47.055371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98b4d-dfac-480f-bae6-5aa3f0b1906b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:47.057600 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f98b4d-dfac-480f-bae6-5aa3f0b1906b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:47.083747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1394/2769] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:46 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:47.084990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6098a58-0aa5-4a64-98e0-8bef49180c93 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:47.096665 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6098a58-0aa5-4a64-98e0-8bef49180c93 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:47.102011 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ac837-87fc-44d4-9d54-a313338ebfa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:47.103030 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ac837-87fc-44d4-9d54-a313338ebfa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:47.103392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ac837-87fc-44d4-9d54-a313338ebfa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:47.103667 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5ac837-87fc-44d4-9d54-a313338ebfa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:47.104399 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ac837-87fc-44d4-9d54-a313338ebfa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:47.106076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5ac837-87fc-44d4-9d54-a313338ebfa9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:47.117818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1376/2770] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:47.123299 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98b4d-dfac-480f-bae6-5aa3f0b1906b admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:47.133657 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f98b4d-dfac-480f-bae6-5aa3f0b1906b admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:47.138351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bff9ad-6aa4-4cfe-80fc-c2a11b128b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:47.139071 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bff9ad-6aa4-4cfe-80fc-c2a11b128b3f admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:47.139350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bff9ad-6aa4-4cfe-80fc-c2a11b128b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:47.139625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bff9ad-6aa4-4cfe-80fc-c2a11b128b3f admin admin] PATH_INFO: `/v3/projects/026cdf2e61e34bd38e52bb806b7343c6/users/698711a6bae5454dad920cf330e05c62/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:47.155504 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bff9ad-6aa4-4cfe-80fc-c2a11b128b3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=026cdf2e61e34bd38e52bb806b7343c6, user_id=698711a6bae5454dad920cf330e05c62, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:47.158153 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bff9ad-6aa4-4cfe-80fc-c2a11b128b3f admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:47.176318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1395/2771] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:47 2022] PUT /identity/v3/projects/026cdf2e61e34bd38e52bb806b7343c6/users/698711a6bae5454dad920cf330e05c62/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:47.178668 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ac837-87fc-44d4-9d54-a313338ebfa9 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:47.184323 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bff9ad-6aa4-4cfe-80fc-c2a11b128b3f admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:47.186100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-43bff9ad-6aa4-4cfe-80fc-c2a11b128b3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:47.189527 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5ac837-87fc-44d4-9d54-a313338ebfa9 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:47.246282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bff9ad-6aa4-4cfe-80fc-c2a11b128b3f admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:47.249353 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c59e3-4962-4aad-beb6-f840d5b410d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:47.249943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833df21-5177-4385-9a09-f9e834d9c20c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:47.250085 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c59e3-4962-4aad-beb6-f840d5b410d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:47.250227 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c59e3-4962-4aad-beb6-f840d5b410d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:47.250497 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c59e3-4962-4aad-beb6-f840d5b410d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:47.250607 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833df21-5177-4385-9a09-f9e834d9c20c service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:47.250915 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833df21-5177-4385-9a09-f9e834d9c20c service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:47.251189 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833df21-5177-4385-9a09-f9e834d9c20c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:47.251306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c59e3-4962-4aad-beb6-f840d5b410d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:47.252788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417c59e3-4962-4aad-beb6-f840d5b410d2 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:47.252933 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e833df21-5177-4385-9a09-f9e834d9c20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:47.266869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1377/2772] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:47 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:47.267865 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c59e3-4962-4aad-beb6-f840d5b410d2 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:47.277889 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c59e3-4962-4aad-beb6-f840d5b410d2 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:47.283267 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac4185-3431-4eff-8e05-368c03b7aebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:47.283911 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4185-3431-4eff-8e05-368c03b7aebb admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:47.284185 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4185-3431-4eff-8e05-368c03b7aebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:47.284453 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac4185-3431-4eff-8e05-368c03b7aebb admin admin] PATH_INFO: `/v3/projects/026cdf2e61e34bd38e52bb806b7343c6/users/698711a6bae5454dad920cf330e05c62/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:47.286386 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac4185-3431-4eff-8e05-368c03b7aebb admin admin] RBAC: Authorizing `identity:create_grant(project_id=026cdf2e61e34bd38e52bb806b7343c6, user_id=698711a6bae5454dad920cf330e05c62, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:47.289099 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac4185-3431-4eff-8e05-368c03b7aebb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:47.300246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1378/2773] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:47 2022] PUT /identity/v3/projects/026cdf2e61e34bd38e52bb806b7343c6/users/698711a6bae5454dad920cf330e05c62/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:47.311916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958672-6ad3-47f1-b8c4-7bca46c77d25 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:47.312196 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958672-6ad3-47f1-b8c4-7bca46c77d25 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:47.312465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81958672-6ad3-47f1-b8c4-7bca46c77d25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:47.318939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833df21-5177-4385-9a09-f9e834d9c20c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:47.320471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833df21-5177-4385-9a09-f9e834d9c20c service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:47.330430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1396/2774] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:47 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:47.342189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-81958672-6ad3-47f1-b8c4-7bca46c77d25 None None] MFA Rules not processed for user `698711a6bae5454dad920cf330e05c62`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:47.343463 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-81958672-6ad3-47f1-b8c4-7bca46c77d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:47.421879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1379/2775] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:47.433965 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833df21-5177-4385-9a09-f9e834d9c20c service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:47.435494 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-e833df21-5177-4385-9a09-f9e834d9c20c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:47.496888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833df21-5177-4385-9a09-f9e834d9c20c service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:47.515085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:47.550456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3bdb91-dbea-4f87-8ca7-bfa427b79f99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:47.551108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bdb91-dbea-4f87-8ca7-bfa427b79f99 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:47.551387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bdb91-dbea-4f87-8ca7-bfa427b79f99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:47.551654 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3bdb91-dbea-4f87-8ca7-bfa427b79f99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:47.609785 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bdb91-dbea-4f87-8ca7-bfa427b79f99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:47.611285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3bdb91-dbea-4f87-8ca7-bfa427b79f99 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:47.620761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1397/2776] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:49.419858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958672-6ad3-47f1-b8c4-7bca46c77d25 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:49.421302 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-81958672-6ad3-47f1-b8c4-7bca46c77d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:49.460740 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:49.515974 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81958672-6ad3-47f1-b8c4-7bca46c77d25 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:49.522068 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:49.522899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:49.523248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:49.523592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] PATH_INFO: `/v3/users/11339078f3aa46138fa66aed5e3a77c0` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:49.525128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11339078f3aa46138fa66aed5e3a77c0)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:49.527739 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:49.589476 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11339078f3aa46138fa66aed5e3a77c0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:49.590395 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11339078f3aa46138fa66aed5e3a77c0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:49.591171 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11339078f3aa46138fa66aed5e3a77c0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:49.606699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11339078f3aa46138fa66aed5e3a77c0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:49.618406 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11339078f3aa46138fa66aed5e3a77c0'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:49.632599 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1380/2777] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:49 2022] DELETE /identity/v3/users/11339078f3aa46138fa66aed5e3a77c0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:49.637630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a57eb0-6511-4a17-9480-cc7f0b4f54bd None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:49.638160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a57eb0-6511-4a17-9480-cc7f0b4f54bd None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:49.638160 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a57eb0-6511-4a17-9480-cc7f0b4f54bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:49.659825 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-53a57eb0-6511-4a17-9480-cc7f0b4f54bd None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:49.661064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-53a57eb0-6511-4a17-9480-cc7f0b4f54bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:49.727284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1398/2778] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:49.749189 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:49.750953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:49.824349 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6999fbb5-30b1-49ea-ac33-eeb526b8b096 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:49.828367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fbc66-0736-4e86-b5ce-a185659bfcaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:49.829132 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fbc66-0736-4e86-b5ce-a185659bfcaa service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:49.829414 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fbc66-0736-4e86-b5ce-a185659bfcaa service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:49.829689 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0fbc66-0736-4e86-b5ce-a185659bfcaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:49.840160 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fbc66-0736-4e86-b5ce-a185659bfcaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:49.841554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0fbc66-0736-4e86-b5ce-a185659bfcaa service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:49.853644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1381/2779] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:50.250836 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a57eb0-6511-4a17-9480-cc7f0b4f54bd None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:50.252340 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-53a57eb0-6511-4a17-9480-cc7f0b4f54bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:50.265418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a57eb0-6511-4a17-9480-cc7f0b4f54bd None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:50.285563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:50.286238 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:50.286515 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:50.286787 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] PATH_INFO: `/v3/projects/dff8e75c8789408ba9e2a08c32af1141` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:50.288091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dff8e75c8789408ba9e2a08c32af1141)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:50.290224 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:50.352951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff8e75c8789408ba9e2a08c32af1141', 'request_id': 'req-0f5b5d30-eccd-45d4-958f-a619450e5659'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.358517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff8e75c8789408ba9e2a08c32af1141', 'request_id': 'req-0f5b5d30-eccd-45d4-958f-a619450e5659'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.367083 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff8e75c8789408ba9e2a08c32af1141', 'request_id': 'req-0f5b5d30-eccd-45d4-958f-a619450e5659'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.374457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:50.379295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] The token cache is being invalidate because project dff8e75c8789408ba9e2a08c32af1141 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:50.379588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.380478 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.382090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1399/2780] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:50 2022] DELETE /identity/v3/projects/dff8e75c8789408ba9e2a08c32af1141 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:50.386413 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fbc66-0736-4e86-b5ce-a185659bfcaa service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:50.397054 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0fbc66-0736-4e86-b5ce-a185659bfcaa service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:50.442056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:50.456736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:50.457418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:50.457695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:50.458017 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] PATH_INFO: `/v3/users/b9e285fdf47f40f092eae080c02d6fe2` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:50.459200 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9e285fdf47f40f092eae080c02d6fe2)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:50.461140 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:50.512916 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9e285fdf47f40f092eae080c02d6fe2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.513555 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9e285fdf47f40f092eae080c02d6fe2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.514147 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9e285fdf47f40f092eae080c02d6fe2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.527048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9e285fdf47f40f092eae080c02d6fe2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.536362 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9e285fdf47f40f092eae080c02d6fe2'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.549150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1382/2781] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:50 2022] DELETE /identity/v3/users/b9e285fdf47f40f092eae080c02d6fe2 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:50.839159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:50.840734 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:50.855474 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5b5d30-eccd-45d4-958f-a619450e5659 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:50.924091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:50.924742 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:50.925021 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:50.925292 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] PATH_INFO: `/v3/projects/6fa06187687441acacb0a5ca783f39e2` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:50.927108 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fa06187687441acacb0a5ca783f39e2)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:50.929029 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:50.977576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fa06187687441acacb0a5ca783f39e2', 'request_id': 'req-ae6995c5-d777-4acc-a6f8-ce128eb56257'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.984006 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fa06187687441acacb0a5ca783f39e2', 'request_id': 'req-ae6995c5-d777-4acc-a6f8-ce128eb56257'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:50.992579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fa06187687441acacb0a5ca783f39e2', 'request_id': 'req-ae6995c5-d777-4acc-a6f8-ce128eb56257'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.004680 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] The token cache is being invalidate because project 6fa06187687441acacb0a5ca783f39e2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:51.004969 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.005632 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.007255 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1400/2782] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:50 2022] DELETE /identity/v3/projects/6fa06187687441acacb0a5ca783f39e2 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:51.011803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:51.013242 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:51.027141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c18f6-a666-4a55-ba7d-07fd25e38c8c admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:51.088327 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:51.088958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:51.089237 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:51.089511 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] PATH_INFO: `/v3/users/89ffec30d1164ecd8a5a13abf35e7c13` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:51.090690 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=89ffec30d1164ecd8a5a13abf35e7c13)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:51.092644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:51.151143 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '89ffec30d1164ecd8a5a13abf35e7c13'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.151767 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '89ffec30d1164ecd8a5a13abf35e7c13'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.152389 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '89ffec30d1164ecd8a5a13abf35e7c13'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.165226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '89ffec30d1164ecd8a5a13abf35e7c13'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.167874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:51.174716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-9bd3f24c-0a38-4ddf-afde-d7bcb2657c1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '89ffec30d1164ecd8a5a13abf35e7c13'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.191006 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1383/2783] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:51 2022] DELETE /identity/v3/users/89ffec30d1164ecd8a5a13abf35e7c13 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:51.488116 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:51.489625 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:51.503334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6995c5-d777-4acc-a6f8-ce128eb56257 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:51.568880 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:51.569541 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:51.569832 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:51.570089 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] PATH_INFO: `/v3/projects/f94967eda48a4e3eac1a4709fc13931a` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:51.571321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=f94967eda48a4e3eac1a4709fc13931a)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:51.573362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:51.616874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:51.632291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f94967eda48a4e3eac1a4709fc13931a', 'request_id': 'req-341f50b8-3492-49d8-a80a-8954f06e3e8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.637808 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f94967eda48a4e3eac1a4709fc13931a', 'request_id': 'req-341f50b8-3492-49d8-a80a-8954f06e3e8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.647187 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f94967eda48a4e3eac1a4709fc13931a', 'request_id': 'req-341f50b8-3492-49d8-a80a-8954f06e3e8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.659245 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] The token cache is being invalidate because project f94967eda48a4e3eac1a4709fc13931a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:51.659453 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.660100 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-341f50b8-3492-49d8-a80a-8954f06e3e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:51.661626 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1401/2784] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:51 2022] DELETE /identity/v3/projects/f94967eda48a4e3eac1a4709fc13931a => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:51.666795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1e8b6-3ee9-44f5-8fa9-0345b4daefbb None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:51.667315 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1e8b6-3ee9-44f5-8fa9-0345b4daefbb None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:51.667438 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b1e8b6-3ee9-44f5-8fa9-0345b4daefbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:51.688220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-51b1e8b6-3ee9-44f5-8fa9-0345b4daefbb None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:51.689469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-51b1e8b6-3ee9-44f5-8fa9-0345b4daefbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:51.764359 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1384/2785] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:51.777549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784b137-48a6-465d-84b8-49c1fd14d181 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:51.777828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784b137-48a6-465d-84b8-49c1fd14d181 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:51.778095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9784b137-48a6-465d-84b8-49c1fd14d181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:51.811095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-9784b137-48a6-465d-84b8-49c1fd14d181 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:51.812416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-9784b137-48a6-465d-84b8-49c1fd14d181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:51.821476 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1402/2786] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:51.825984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1e8b6-3ee9-44f5-8fa9-0345b4daefbb None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:51.838991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b1e8b6-3ee9-44f5-8fa9-0345b4daefbb None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:51.843946 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f46013-59fd-4c3d-b451-d4ff768aea8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:51.844622 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f46013-59fd-4c3d-b451-d4ff768aea8b admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:51.844901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f46013-59fd-4c3d-b451-d4ff768aea8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:51.845262 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f46013-59fd-4c3d-b451-d4ff768aea8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:51.846203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f46013-59fd-4c3d-b451-d4ff768aea8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:51.846665 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f46013-59fd-4c3d-b451-d4ff768aea8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:51.849199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f46013-59fd-4c3d-b451-d4ff768aea8b admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:51.867912 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1385/2787] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:14:51.873256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784b137-48a6-465d-84b8-49c1fd14d181 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:51.884545 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9784b137-48a6-465d-84b8-49c1fd14d181 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:51.891931 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27394684-7937-417b-942d-fdf64aea7a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:51.892973 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27394684-7937-417b-942d-fdf64aea7a58 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:51.893343 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27394684-7937-417b-942d-fdf64aea7a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:51.893615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27394684-7937-417b-942d-fdf64aea7a58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:51.894260 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27394684-7937-417b-942d-fdf64aea7a58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:51.896257 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27394684-7937-417b-942d-fdf64aea7a58 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:51.930755 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1403/2788] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:51 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:51.935900 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f46013-59fd-4c3d-b451-d4ff768aea8b admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:51.950643 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f46013-59fd-4c3d-b451-d4ff768aea8b admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:52.030397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf667d-6cb3-459d-85f3-0008aaf5f1d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:52.031016 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf667d-6cb3-459d-85f3-0008aaf5f1d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:52.031294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf667d-6cb3-459d-85f3-0008aaf5f1d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:52.031565 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcf667d-6cb3-459d-85f3-0008aaf5f1d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:52.032195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf667d-6cb3-459d-85f3-0008aaf5f1d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:52.034299 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcf667d-6cb3-459d-85f3-0008aaf5f1d1 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:52.062084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1386/2789] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:51 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:52.063658 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27394684-7937-417b-942d-fdf64aea7a58 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:52.063907 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf667d-6cb3-459d-85f3-0008aaf5f1d1 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:52.065372 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-27394684-7937-417b-942d-fdf64aea7a58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:52.074827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcf667d-6cb3-459d-85f3-0008aaf5f1d1 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:52.079841 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba666-a655-4edf-994b-01b9a440dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:52.080456 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba666-a655-4edf-994b-01b9a440dc37 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:52.080736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba666-a655-4edf-994b-01b9a440dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:52.081076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3ba666-a655-4edf-994b-01b9a440dc37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:52.081736 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba666-a655-4edf-994b-01b9a440dc37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:52.084154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c3ba666-a655-4edf-994b-01b9a440dc37 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:52.096193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1387/2790] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:52.100336 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba666-a655-4edf-994b-01b9a440dc37 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:52.112142 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3ba666-a655-4edf-994b-01b9a440dc37 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:52.117096 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b031fc-bdf7-48a2-a2c7-e59c902f9411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:52.117704 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b031fc-bdf7-48a2-a2c7-e59c902f9411 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:52.117978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b031fc-bdf7-48a2-a2c7-e59c902f9411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:52.118494 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b031fc-bdf7-48a2-a2c7-e59c902f9411 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:52.118989 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b031fc-bdf7-48a2-a2c7-e59c902f9411 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:52.120615 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b031fc-bdf7-48a2-a2c7-e59c902f9411 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:52.130896 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1388/2791] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:14:52.138491 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27394684-7937-417b-942d-fdf64aea7a58 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:52.138719 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b031fc-bdf7-48a2-a2c7-e59c902f9411 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:52.142672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bc890-4c0d-46ed-915e-d9bac7622754 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:52.143348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bc890-4c0d-46ed-915e-d9bac7622754 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:52.143624 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bc890-4c0d-46ed-915e-d9bac7622754 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:52.143891 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8bc890-4c0d-46ed-915e-d9bac7622754 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:52.145924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-dc8bc890-4c0d-46ed-915e-d9bac7622754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:52.154818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b031fc-bdf7-48a2-a2c7-e59c902f9411 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:52.161869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e43b19-a24d-4018-931b-045eb1fd4a76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:52.162868 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43b19-a24d-4018-931b-045eb1fd4a76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:52.163119 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43b19-a24d-4018-931b-045eb1fd4a76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:52.163423 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e43b19-a24d-4018-931b-045eb1fd4a76 admin admin] PATH_INFO: `/v3/projects/856361da670f496cb9c9910aba4ba71b/users/a0baa80d73624f5fa3f6431f7b6e9860/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:52.182863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e43b19-a24d-4018-931b-045eb1fd4a76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=856361da670f496cb9c9910aba4ba71b, user_id=a0baa80d73624f5fa3f6431f7b6e9860, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:52.186645 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e43b19-a24d-4018-931b-045eb1fd4a76 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:52.203741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1389/2792] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:52 2022] PUT /identity/v3/projects/856361da670f496cb9c9910aba4ba71b/users/a0baa80d73624f5fa3f6431f7b6e9860/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:14:52.210468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d15846-f029-4a66-aa3e-27f1c69118c4 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:52.210757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d15846-f029-4a66-aa3e-27f1c69118c4 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:52.211056 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d15846-f029-4a66-aa3e-27f1c69118c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:52.231595 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bc890-4c0d-46ed-915e-d9bac7622754 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:52.233427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8bc890-4c0d-46ed-915e-d9bac7622754 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:52.237781 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-d0d15846-f029-4a66-aa3e-27f1c69118c4 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:52.239028 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-d0d15846-f029-4a66-aa3e-27f1c69118c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:52.245609 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1404/2793] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:14:52.256187 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:52.321835 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1390/2794] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:52.335757 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bc890-4c0d-46ed-915e-d9bac7622754 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:52.336846 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-dc8bc890-4c0d-46ed-915e-d9bac7622754 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:52.394054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:52.414014 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8bc890-4c0d-46ed-915e-d9bac7622754 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:52.479696 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1df52-ecb1-47a6-aec8-bf6483987168 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:52.480324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1df52-ecb1-47a6-aec8-bf6483987168 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:52.480599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1df52-ecb1-47a6-aec8-bf6483987168 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:52.480861 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c1df52-ecb1-47a6-aec8-bf6483987168 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:52.491722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1df52-ecb1-47a6-aec8-bf6483987168 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:52.493351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c1df52-ecb1-47a6-aec8-bf6483987168 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:52.506535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1405/2795] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:53.222581 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a064b-0ab8-42ff-ab6f-e080bbb5179a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:53.223128 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a064b-0ab8-42ff-ab6f-e080bbb5179a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:53.223245 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a064b-0ab8-42ff-ab6f-e080bbb5179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:53.251832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-222a064b-0ab8-42ff-ab6f-e080bbb5179a None None] MFA Rules not processed for user `a0baa80d73624f5fa3f6431f7b6e9860`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:53.253041 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-222a064b-0ab8-42ff-ab6f-e080bbb5179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:53.324418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1391/2796] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:53.340571 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1df52-ecb1-47a6-aec8-bf6483987168 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:53.404870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c1df52-ecb1-47a6-aec8-bf6483987168 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:53.416204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e952f-7086-4fb6-a429-5e5a927e56e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:53.416204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e952f-7086-4fb6-a429-5e5a927e56e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:53.416759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e952f-7086-4fb6-a429-5e5a927e56e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:53.416858 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549e952f-7086-4fb6-a429-5e5a927e56e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:53.426048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e952f-7086-4fb6-a429-5e5a927e56e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:53.427546 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549e952f-7086-4fb6-a429-5e5a927e56e8 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:53.437159 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1406/2797] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:53 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:54.816270 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0843f-4b2e-4d62-ad3b-37725cc99757 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:54.816825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0843f-4b2e-4d62-ad3b-37725cc99757 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:54.816825 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa0843f-4b2e-4d62-ad3b-37725cc99757 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:54.839015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ffa0843f-4b2e-4d62-ad3b-37725cc99757 None None] MFA Rules not processed for user `a0baa80d73624f5fa3f6431f7b6e9860`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:54.840234 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ffa0843f-4b2e-4d62-ad3b-37725cc99757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:54.848253 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1392/2798] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:54 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:57.270792 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e952f-7086-4fb6-a429-5e5a927e56e8 service cinder] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:57.272477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-549e952f-7086-4fb6-a429-5e5a927e56e8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:57.288466 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549e952f-7086-4fb6-a429-5e5a927e56e8 service cinder] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:57.294378 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:57.295041 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:57.295348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:57.295618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] PATH_INFO: `/v3/users/270ed994e77540b9bfd8129bf2f1ef1a` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:57.296806 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] RBAC: Authorizing `identity:delete_user(user_id=270ed994e77540b9bfd8129bf2f1ef1a)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:57.298949 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:57.350682 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '270ed994e77540b9bfd8129bf2f1ef1a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:57.363751 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '270ed994e77540b9bfd8129bf2f1ef1a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:57.373002 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '270ed994e77540b9bfd8129bf2f1ef1a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:57.381148 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '270ed994e77540b9bfd8129bf2f1ef1a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:57.381930 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '270ed994e77540b9bfd8129bf2f1ef1a'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:57.388186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1407/2799] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:57 2022] DELETE /identity/v3/users/270ed994e77540b9bfd8129bf2f1ef1a => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:57.393157 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5c05-16c4-4431-a391-a191dc906347 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:57.393693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5c05-16c4-4431-a391-a191dc906347 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:57.393693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030d5c05-16c4-4431-a391-a191dc906347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:57.413338 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-030d5c05-16c4-4431-a391-a191dc906347 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:57.414762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-030d5c05-16c4-4431-a391-a191dc906347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:57.485518 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1393/2800] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:57.497361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:57.499001 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:57.519219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:57.575507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ef1bea-4201-4f7f-9a07-ed376c41e11a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:57.579442 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a9360-9fdf-4615-87e9-612cf1c22671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:57.580054 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a9360-9fdf-4615-87e9-612cf1c22671 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:57.580329 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a9360-9fdf-4615-87e9-612cf1c22671 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:57.580605 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338a9360-9fdf-4615-87e9-612cf1c22671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:57.594793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a9360-9fdf-4615-87e9-612cf1c22671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:57.596237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338a9360-9fdf-4615-87e9-612cf1c22671 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:57.606879 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1408/2801] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:14:57.914720 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5c05-16c4-4431-a391-a191dc906347 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:57.916508 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-030d5c05-16c4-4431-a391-a191dc906347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:57.933496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030d5c05-16c4-4431-a391-a191dc906347 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:57.940085 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:57.940662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:57.940920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:57.941201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] PATH_INFO: `/v3/projects/3f15d9b766f04cb68fff34c8904a1131` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:57.942457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f15d9b766f04cb68fff34c8904a1131)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:57.944556 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:57.986713 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:57.997674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f15d9b766f04cb68fff34c8904a1131', 'request_id': 'req-bb813a1c-8859-488e-9502-ba902e433eda'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.006655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f15d9b766f04cb68fff34c8904a1131', 'request_id': 'req-bb813a1c-8859-488e-9502-ba902e433eda'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.013496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f15d9b766f04cb68fff34c8904a1131', 'request_id': 'req-bb813a1c-8859-488e-9502-ba902e433eda'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.024484 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] The token cache is being invalidate because project 3f15d9b766f04cb68fff34c8904a1131 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:58.024805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.025582 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.027214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1394/2802] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:57 2022] DELETE /identity/v3/projects/3f15d9b766f04cb68fff34c8904a1131 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:58.031430 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a9360-9fdf-4615-87e9-612cf1c22671 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:58.041811 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338a9360-9fdf-4615-87e9-612cf1c22671 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:58.106623 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:58.107284 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:58.107582 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:58.107849 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] PATH_INFO: `/v3/users/698711a6bae5454dad920cf330e05c62` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:58.109055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=698711a6bae5454dad920cf330e05c62)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:58.111061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:58.163244 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '698711a6bae5454dad920cf330e05c62'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.175204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '698711a6bae5454dad920cf330e05c62'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.185095 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '698711a6bae5454dad920cf330e05c62'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.192439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '698711a6bae5454dad920cf330e05c62'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.193082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a6f982bf-ada0-435d-9dfb-6ec4162e05d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '698711a6bae5454dad920cf330e05c62'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.199544 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1409/2803] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:14:58 2022] DELETE /identity/v3/users/698711a6bae5454dad920cf330e05c62 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:58.487890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:58.489571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:58.504997 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb813a1c-8859-488e-9502-ba902e433eda admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:58.570845 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:58.571457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:58.571734 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:58.572005 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] PATH_INFO: `/v3/projects/026cdf2e61e34bd38e52bb806b7343c6` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:58.573149 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=026cdf2e61e34bd38e52bb806b7343c6)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:58.575109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:58.636284 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026cdf2e61e34bd38e52bb806b7343c6', 'request_id': 'req-d5d29439-a62b-469f-af30-2e37bd12fddd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.645693 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026cdf2e61e34bd38e52bb806b7343c6', 'request_id': 'req-d5d29439-a62b-469f-af30-2e37bd12fddd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.652611 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026cdf2e61e34bd38e52bb806b7343c6', 'request_id': 'req-d5d29439-a62b-469f-af30-2e37bd12fddd'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.663658 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] The token cache is being invalidate because project 026cdf2e61e34bd38e52bb806b7343c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:14:58.663941 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.664608 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-d5d29439-a62b-469f-af30-2e37bd12fddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:14:58.666366 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1395/2804] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:14:58 2022] DELETE /identity/v3/projects/026cdf2e61e34bd38e52bb806b7343c6 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:58.672847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85de5e-2b89-46ac-a5fa-78e2aafa2718 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:58.673311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85de5e-2b89-46ac-a5fa-78e2aafa2718 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:58.673420 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c85de5e-2b89-46ac-a5fa-78e2aafa2718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:58.694475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-8c85de5e-2b89-46ac-a5fa-78e2aafa2718 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:58.697457 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8c85de5e-2b89-46ac-a5fa-78e2aafa2718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:58.733960 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:58.782978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1410/2805] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:58.791656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455f61-0ad9-451f-8321-10fde66b1bca None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:58.791945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455f61-0ad9-451f-8321-10fde66b1bca None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:58.792221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa455f61-0ad9-451f-8321-10fde66b1bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:58.814139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-aa455f61-0ad9-451f-8321-10fde66b1bca None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:58.815392 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aa455f61-0ad9-451f-8321-10fde66b1bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:58.824533 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1396/2806] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 18 21:14:58.828820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85de5e-2b89-46ac-a5fa-78e2aafa2718 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:58.839818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c85de5e-2b89-46ac-a5fa-78e2aafa2718 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:58.844915 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecef848-a17c-4be5-8321-335144a6e6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:58.845530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecef848-a17c-4be5-8321-335144a6e6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:58.845807 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecef848-a17c-4be5-8321-335144a6e6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:58.846074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecef848-a17c-4be5-8321-335144a6e6f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:58.846720 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecef848-a17c-4be5-8321-335144a6e6f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81587) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:14:58.847048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecef848-a17c-4be5-8321-335144a6e6f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:58.848699 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecef848-a17c-4be5-8321-335144a6e6f7 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:58.861065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1411/2807] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 18 21:14:58.866154 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa455f61-0ad9-451f-8321-10fde66b1bca None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:58.876602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa455f61-0ad9-451f-8321-10fde66b1bca None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:58.881834 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74a1a1-c030-4cc0-a0f6-4816e559ab1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:58.882436 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74a1a1-c030-4cc0-a0f6-4816e559ab1e admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:58.882710 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74a1a1-c030-4cc0-a0f6-4816e559ab1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:58.883010 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b74a1a1-c030-4cc0-a0f6-4816e559ab1e admin admin] PATH_INFO: `/v3/projects` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:58.883674 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74a1a1-c030-4cc0-a0f6-4816e559ab1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:58.885681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b74a1a1-c030-4cc0-a0f6-4816e559ab1e admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:58.921081 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1397/2808] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:14:58 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:58.925402 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecef848-a17c-4be5-8321-335144a6e6f7 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:58.937146 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecef848-a17c-4be5-8321-335144a6e6f7 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:59.001525 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466210c-1bc4-49f5-a4a2-959821a981fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:59.002142 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466210c-1bc4-49f5-a4a2-959821a981fc admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:59.002412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466210c-1bc4-49f5-a4a2-959821a981fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:59.002693 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4466210c-1bc4-49f5-a4a2-959821a981fc admin admin] PATH_INFO: `/v3/users` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:59.003357 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466210c-1bc4-49f5-a4a2-959821a981fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:59.005321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4466210c-1bc4-49f5-a4a2-959821a981fc admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:59.028739 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1412/2809] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:14:58 2022] POST /identity/v3/users => generated 296 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:14:59.033051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74a1a1-c030-4cc0-a0f6-4816e559ab1e admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:59.043495 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b74a1a1-c030-4cc0-a0f6-4816e559ab1e admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:59.048319 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59381760-2983-4b70-9c41-3d14bf8b61fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:59.048920 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59381760-2983-4b70-9c41-3d14bf8b61fb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:59.049199 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59381760-2983-4b70-9c41-3d14bf8b61fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:59.049469 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59381760-2983-4b70-9c41-3d14bf8b61fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:59.050118 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59381760-2983-4b70-9c41-3d14bf8b61fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:59.051762 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59381760-2983-4b70-9c41-3d14bf8b61fb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:59.063117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1398/2810] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:59.067853 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466210c-1bc4-49f5-a4a2-959821a981fc admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:59.084336 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4466210c-1bc4-49f5-a4a2-959821a981fc admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:59.090649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d877c9-c5cf-4496-bc77-19098344c6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:59.091285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d877c9-c5cf-4496-bc77-19098344c6cd admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:59.091572 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d877c9-c5cf-4496-bc77-19098344c6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:59.091843 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d877c9-c5cf-4496-bc77-19098344c6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:59.092465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d877c9-c5cf-4496-bc77-19098344c6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:59.094112 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d877c9-c5cf-4496-bc77-19098344c6cd admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:59.105392 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1413/2811] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:14:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:14:59.109754 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59381760-2983-4b70-9c41-3d14bf8b61fb admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:59.120972 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59381760-2983-4b70-9c41-3d14bf8b61fb admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:59.126503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ec09a-c3b0-4e03-8805-337fdbb4b3d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:59.127195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ec09a-c3b0-4e03-8805-337fdbb4b3d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:59.127473 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ec09a-c3b0-4e03-8805-337fdbb4b3d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:59.127741 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ec09a-c3b0-4e03-8805-337fdbb4b3d0 admin admin] PATH_INFO: `/v3/projects/1884b7c3541b4b6d9d5a0c3a3998987c/users/827284d88ae642d785fcd79ef0f56cea/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:59.139732 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:14:59.144672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ec09a-c3b0-4e03-8805-337fdbb4b3d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1884b7c3541b4b6d9d5a0c3a3998987c, user_id=827284d88ae642d785fcd79ef0f56cea, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:59.148022 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16ec09a-c3b0-4e03-8805-337fdbb4b3d0 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:59.164306 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1399/2812] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:14:59 2022] PUT /identity/v3/projects/1884b7c3541b4b6d9d5a0c3a3998987c/users/827284d88ae642d785fcd79ef0f56cea/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:14:59.177604 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48156aa-fa80-4852-b51e-02dc5d023603 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:59.177890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48156aa-fa80-4852-b51e-02dc5d023603 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:59.178161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48156aa-fa80-4852-b51e-02dc5d023603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:59.208259 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-b48156aa-fa80-4852-b51e-02dc5d023603 None None] MFA Rules not processed for user `827284d88ae642d785fcd79ef0f56cea`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:14:59.209475 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b48156aa-fa80-4852-b51e-02dc5d023603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:59.278121 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1414/2813] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:14:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:14:59.289991 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ec09a-c3b0-4e03-8805-337fdbb4b3d0 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:14:59.291953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e16ec09a-c3b0-4e03-8805-337fdbb4b3d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:14:59.358656 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16ec09a-c3b0-4e03-8805-337fdbb4b3d0 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:14:59.362701 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a0b78d-fab4-474a-b06d-f84d9bde47a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:14:59.363342 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b78d-fab4-474a-b06d-f84d9bde47a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:14:59.363625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b78d-fab4-474a-b06d-f84d9bde47a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:14:59.363895 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a0b78d-fab4-474a-b06d-f84d9bde47a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:14:59.373042 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0b78d-fab4-474a-b06d-f84d9bde47a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:14:59.374517 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a0b78d-fab4-474a-b06d-f84d9bde47a9 service cinder] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:14:59.383838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1400/2814] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:14:59 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:15:09.275416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:09.379485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:16.842649 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48156aa-fa80-4852-b51e-02dc5d023603 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:16.917939 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48156aa-fa80-4852-b51e-02dc5d023603 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:16.923174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:16.924251 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:16.924718 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:16.925174 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] PATH_INFO: `/v3/users/827284d88ae642d785fcd79ef0f56cea` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:16.927208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=827284d88ae642d785fcd79ef0f56cea)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:16.930356 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:16.994177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '827284d88ae642d785fcd79ef0f56cea'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:17.021009 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '827284d88ae642d785fcd79ef0f56cea'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:17.031921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '827284d88ae642d785fcd79ef0f56cea'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:17.041731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '827284d88ae642d785fcd79ef0f56cea'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:17.042560 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '827284d88ae642d785fcd79ef0f56cea'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:17.048892 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1415/2815] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:15:16 2022] DELETE /identity/v3/users/827284d88ae642d785fcd79ef0f56cea => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:15:17.055261 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3883b5-0b4a-429a-b6c9-9a3406d431c3 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:17.055776 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3883b5-0b4a-429a-b6c9-9a3406d431c3 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:17.056151 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3883b5-0b4a-429a-b6c9-9a3406d431c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:17.080265 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-ca3883b5-0b4a-429a-b6c9-9a3406d431c3 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:17.081496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca3883b5-0b4a-429a-b6c9-9a3406d431c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:17.149874 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1401/2816] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:15:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:17.160412 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:17.162063 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:17.232633 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1912df7-cd17-44f8-9025-068557738cb8 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:17.236465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94e964-7eef-4011-8447-5420ade0894a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:17.237090 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94e964-7eef-4011-8447-5420ade0894a service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:17.237363 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94e964-7eef-4011-8447-5420ade0894a service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:17.237634 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94e964-7eef-4011-8447-5420ade0894a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:17.248794 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94e964-7eef-4011-8447-5420ade0894a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:17.250173 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94e964-7eef-4011-8447-5420ade0894a service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:17.260362 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1416/2817] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:15:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:15:17.579786 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3883b5-0b4a-429a-b6c9-9a3406d431c3 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:17.581417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca3883b5-0b4a-429a-b6c9-9a3406d431c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:17.596428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3883b5-0b4a-429a-b6c9-9a3406d431c3 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:17.603162 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:17.603851 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:17.604111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:17.604407 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] PATH_INFO: `/v3/projects/1884b7c3541b4b6d9d5a0c3a3998987c` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:17.605548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1884b7c3541b4b6d9d5a0c3a3998987c)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:17.607522 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:17.661297 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1884b7c3541b4b6d9d5a0c3a3998987c', 'request_id': 'req-55394f92-3054-41db-bda2-ce4af554903a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:17.672773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1884b7c3541b4b6d9d5a0c3a3998987c', 'request_id': 'req-55394f92-3054-41db-bda2-ce4af554903a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:17.682803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1884b7c3541b4b6d9d5a0c3a3998987c', 'request_id': 'req-55394f92-3054-41db-bda2-ce4af554903a'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:17.694090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] The token cache is being invalidate because project 1884b7c3541b4b6d9d5a0c3a3998987c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:15:17.694383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:17.695141 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-55394f92-3054-41db-bda2-ce4af554903a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:17.696677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1402/2818] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:15:17 2022] DELETE /identity/v3/projects/1884b7c3541b4b6d9d5a0c3a3998987c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:15:18.564305 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5ebb-d786-400a-b502-5ca95648b646 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:18.564803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5ebb-d786-400a-b502-5ca95648b646 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:18.564803 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069d5ebb-d786-400a-b502-5ca95648b646 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:18.585263 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-069d5ebb-d786-400a-b502-5ca95648b646 None None] MFA Rules not processed for user `a0baa80d73624f5fa3f6431f7b6e9860`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:18.587199 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-069d5ebb-d786-400a-b502-5ca95648b646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:18.606593 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:18.654379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1417/2819] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:15:18 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:27.690969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:28.647455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=15 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:36.528390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb54d6f-2a3f-4f3f-8d88-e00ad9b673a5 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:36.528863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb54d6f-2a3f-4f3f-8d88-e00ad9b673a5 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:36.528981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb54d6f-2a3f-4f3f-8d88-e00ad9b673a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:36.559177 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-feb54d6f-2a3f-4f3f-8d88-e00ad9b673a5 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:36.560435 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-feb54d6f-2a3f-4f3f-8d88-e00ad9b673a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:36.634753 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1403/2820] 10.222.0.59 () {58 vars in 1009 bytes} [Thu Aug 18 21:15:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:36.685555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d5ebb-d786-400a-b502-5ca95648b646 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:36.687267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-069d5ebb-d786-400a-b502-5ca95648b646 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:36.763318 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069d5ebb-d786-400a-b502-5ca95648b646 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:36.769207 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ea305-49b3-4506-ac37-bb2201c6e980 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:36.769821 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea305-49b3-4506-ac37-bb2201c6e980 service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:36.770091 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea305-49b3-4506-ac37-bb2201c6e980 service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:36.770377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ea305-49b3-4506-ac37-bb2201c6e980 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:36.779384 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ea305-49b3-4506-ac37-bb2201c6e980 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:36.781015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ea305-49b3-4506-ac37-bb2201c6e980 service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:36.789885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1418/2821] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:15:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:15:46.626664 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=32 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:46.786191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=32 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:51.047111 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bef0-c953-4a80-b062-329801a2a580 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:51.047602 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bef0-c953-4a80-b062-329801a2a580 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:51.047703 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b32bef0-c953-4a80-b062-329801a2a580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:51.067432 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2b32bef0-c953-4a80-b062-329801a2a580 None None] MFA Rules not processed for user `773fb77106de4530a089e7abca48e333`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:51.068635 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2b32bef0-c953-4a80-b062-329801a2a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:51.076298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1404/2822] 10.222.0.59 () {58 vars in 967 bytes} [Thu Aug 18 21:15:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:51.091999 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ea305-49b3-4506-ac37-bb2201c6e980 service swift] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:51.103098 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ea305-49b3-4506-ac37-bb2201c6e980 service swift] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:51.109473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de7dbe-f7ee-417a-82d9-ef9ae5eb5c82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '410e8bceb7664e1d9968f85f41cc0828', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:51.110075 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de7dbe-f7ee-417a-82d9-ef9ae5eb5c82 service swift] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:51.110349 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de7dbe-f7ee-417a-82d9-ef9ae5eb5c82 service swift] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:51.110613 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03de7dbe-f7ee-417a-82d9-ef9ae5eb5c82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:51.119074 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de7dbe-f7ee-417a-82d9-ef9ae5eb5c82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:51.120664 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03de7dbe-f7ee-417a-82d9-ef9ae5eb5c82 service swift] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:51.129061 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1419/2823] 10.222.0.59 () {60 vars in 1384 bytes} [Thu Aug 18 21:15:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 18 21:15:53.135255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32bef0-c953-4a80-b062-329801a2a580 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:53.137573 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2b32bef0-c953-4a80-b062-329801a2a580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:53.216379 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b32bef0-c953-4a80-b062-329801a2a580 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:53.222014 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:53.222662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:53.222971 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:53.223243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] PATH_INFO: `/v3/users/a0baa80d73624f5fa3f6431f7b6e9860` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:53.224503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0baa80d73624f5fa3f6431f7b6e9860)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:53.226498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:53.281486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0baa80d73624f5fa3f6431f7b6e9860'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:53.282222 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0baa80d73624f5fa3f6431f7b6e9860'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:53.282947 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0baa80d73624f5fa3f6431f7b6e9860'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:53.295471 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0baa80d73624f5fa3f6431f7b6e9860'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:53.305190 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-793a71fa-93a2-4498-83fd-f5caa2a894f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0baa80d73624f5fa3f6431f7b6e9860'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:53.318799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1405/2824] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:15:53 2022] DELETE /identity/v3/users/a0baa80d73624f5fa3f6431f7b6e9860 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:15:53.499287 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de7dbe-f7ee-417a-82d9-ef9ae5eb5c82 service swift] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:53.512978 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03de7dbe-f7ee-417a-82d9-ef9ae5eb5c82 service swift] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:53.575056 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:53.575689 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:53.575975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:53.576230 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] PATH_INFO: `/v3/projects/856361da670f496cb9c9910aba4ba71b` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:53.577393 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] RBAC: Authorizing `identity:delete_project(project_id=856361da670f496cb9c9910aba4ba71b)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:53.579606 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:53.643823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '856361da670f496cb9c9910aba4ba71b', 'request_id': 'req-a47c7f79-89da-4ebe-a3c1-7405b7928523'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:53.650125 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '856361da670f496cb9c9910aba4ba71b', 'request_id': 'req-a47c7f79-89da-4ebe-a3c1-7405b7928523'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:53.659896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '856361da670f496cb9c9910aba4ba71b', 'request_id': 'req-a47c7f79-89da-4ebe-a3c1-7405b7928523'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:53.672196 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] The token cache is being invalidate because project 856361da670f496cb9c9910aba4ba71b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:15:53.672585 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:53.673307 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a47c7f79-89da-4ebe-a3c1-7405b7928523 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:15:53.675060 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1420/2825] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:15:53 2022] DELETE /identity/v3/projects/856361da670f496cb9c9910aba4ba71b => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:15:53.680053 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ef37-6283-4a7f-95d7-635124012fe6 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:53.680341 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ef37-6283-4a7f-95d7-635124012fe6 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:53.680621 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d5ef37-6283-4a7f-95d7-635124012fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:53.701818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-11d5ef37-6283-4a7f-95d7-635124012fe6 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:53.703369 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-11d5ef37-6283-4a7f-95d7-635124012fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:53.766313 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1406/2826] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:53.773887 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a926e-9da2-4829-9618-b416101109e8 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:53.774175 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a926e-9da2-4829-9618-b416101109e8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:53.774452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a926e-9da2-4829-9618-b416101109e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:53.794549 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-f34a926e-9da2-4829-9618-b416101109e8 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:53.795885 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-f34a926e-9da2-4829-9618-b416101109e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:53.804790 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1421/2827] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:15:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:53.809567 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5ef37-6283-4a7f-95d7-635124012fe6 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:53.819873 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d5ef37-6283-4a7f-95d7-635124012fe6 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:53.825035 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d748942-35fb-4d50-8f59-53db916de8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:53.825662 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d748942-35fb-4d50-8f59-53db916de8fa admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:53.826049 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d748942-35fb-4d50-8f59-53db916de8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:53.826323 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d748942-35fb-4d50-8f59-53db916de8fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:53.827021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d748942-35fb-4d50-8f59-53db916de8fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:15:53.827322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d748942-35fb-4d50-8f59-53db916de8fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:53.829528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d748942-35fb-4d50-8f59-53db916de8fa admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:53.839137 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:53.842716 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1407/2828] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:15:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:15:53.847738 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a926e-9da2-4829-9618-b416101109e8 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:53.857239 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a926e-9da2-4829-9618-b416101109e8 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:53.862921 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d7425-3d79-410c-8648-b9284717bc89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:53.863712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d7425-3d79-410c-8648-b9284717bc89 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:53.863994 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d7425-3d79-410c-8648-b9284717bc89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:53.864268 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6d7425-3d79-410c-8648-b9284717bc89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:53.864906 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d7425-3d79-410c-8648-b9284717bc89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:53.867055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6d7425-3d79-410c-8648-b9284717bc89 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:53.910630 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1422/2829] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:15:53 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:15:53.913809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d748942-35fb-4d50-8f59-53db916de8fa admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:53.924681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d748942-35fb-4d50-8f59-53db916de8fa admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:53.996256 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d3a91-1fc4-4873-81d9-f3a913685e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:53.996863 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d3a91-1fc4-4873-81d9-f3a913685e5a admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:53.997156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d3a91-1fc4-4873-81d9-f3a913685e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:53.997405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108d3a91-1fc4-4873-81d9-f3a913685e5a admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:53.998018 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d3a91-1fc4-4873-81d9-f3a913685e5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:53.999992 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108d3a91-1fc4-4873-81d9-f3a913685e5a admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:54.028601 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1408/2830] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:15:53 2022] POST /identity/v3/users => generated 287 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:15:54.033332 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d7425-3d79-410c-8648-b9284717bc89 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:54.049235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6d7425-3d79-410c-8648-b9284717bc89 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:54.058084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee03aa4-57b9-4a25-bc1d-d30bd19074bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:54.058745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee03aa4-57b9-4a25-bc1d-d30bd19074bf admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:54.059109 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee03aa4-57b9-4a25-bc1d-d30bd19074bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:54.059432 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee03aa4-57b9-4a25-bc1d-d30bd19074bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:54.060383 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee03aa4-57b9-4a25-bc1d-d30bd19074bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:54.062924 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee03aa4-57b9-4a25-bc1d-d30bd19074bf admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:54.073719 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1423/2831] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 18 21:15:54.077935 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d3a91-1fc4-4873-81d9-f3a913685e5a admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:54.089091 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108d3a91-1fc4-4873-81d9-f3a913685e5a admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:54.094358 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65703fdb-517f-40e4-bc23-dd5689850205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:54.094990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703fdb-517f-40e4-bc23-dd5689850205 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:54.095268 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703fdb-517f-40e4-bc23-dd5689850205 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:54.095532 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65703fdb-517f-40e4-bc23-dd5689850205 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:54.096174 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65703fdb-517f-40e4-bc23-dd5689850205 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:54.097788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65703fdb-517f-40e4-bc23-dd5689850205 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:54.108496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1409/2832] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:15:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:15:54.113496 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee03aa4-57b9-4a25-bc1d-d30bd19074bf admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:54.128028 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee03aa4-57b9-4a25-bc1d-d30bd19074bf admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:54.133817 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88627ade-1f83-4e79-8e4c-2131aef48979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:54.134473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88627ade-1f83-4e79-8e4c-2131aef48979 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:54.134750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88627ade-1f83-4e79-8e4c-2131aef48979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:54.135058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88627ade-1f83-4e79-8e4c-2131aef48979 admin admin] PATH_INFO: `/v3/projects/d2b8bc9125d345fb8e7b9d57c757a08d/users/2218bdf8ec1d4ababbaf9ea34615a315/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:54.151191 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88627ade-1f83-4e79-8e4c-2131aef48979 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2b8bc9125d345fb8e7b9d57c757a08d, user_id=2218bdf8ec1d4ababbaf9ea34615a315, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:54.153851 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88627ade-1f83-4e79-8e4c-2131aef48979 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:54.171714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1424/2833] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:15:54 2022] PUT /identity/v3/projects/d2b8bc9125d345fb8e7b9d57c757a08d/users/2218bdf8ec1d4ababbaf9ea34615a315/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:15:54.244036 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2940d-69a2-4f3c-8c13-fa35857307d9 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:54.244649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2940d-69a2-4f3c-8c13-fa35857307d9 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:54.244649 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf2940d-69a2-4f3c-8c13-fa35857307d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:54.276746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-7cf2940d-69a2-4f3c-8c13-fa35857307d9 None None] MFA Rules not processed for user `2218bdf8ec1d4ababbaf9ea34615a315`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:15:54.277981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-7cf2940d-69a2-4f3c-8c13-fa35857307d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:54.348398 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1410/2834] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:15:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:15:54.359271 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88627ade-1f83-4e79-8e4c-2131aef48979 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:15:54.361872 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-88627ade-1f83-4e79-8e4c-2131aef48979 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:15:54.369046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:15:54.424389 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88627ade-1f83-4e79-8e4c-2131aef48979 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:15:54.428793 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f321345-af60-4b7b-a391-f983c432d77e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:15:54.429405 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321345-af60-4b7b-a391-f983c432d77e service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:15:54.429713 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321345-af60-4b7b-a391-f983c432d77e service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:15:54.429985 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f321345-af60-4b7b-a391-f983c432d77e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:15:54.439548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f321345-af60-4b7b-a391-f983c432d77e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:15:54.441034 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f321345-af60-4b7b-a391-f983c432d77e service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:15:54.450166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1425/2835] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:15:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:04.345058 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=66,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:04.446196 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=24 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:04.913396 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2940d-69a2-4f3c-8c13-fa35857307d9 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:04.979090 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf2940d-69a2-4f3c-8c13-fa35857307d9 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:04.984269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:04.984886 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:04.985156 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:04.985421 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] PATH_INFO: `/v3/users/2218bdf8ec1d4ababbaf9ea34615a315` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:04.986651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2218bdf8ec1d4ababbaf9ea34615a315)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:04.988686 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:05.037203 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2218bdf8ec1d4ababbaf9ea34615a315'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:05.037773 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2218bdf8ec1d4ababbaf9ea34615a315'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:05.038365 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2218bdf8ec1d4ababbaf9ea34615a315'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:05.050748 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2218bdf8ec1d4ababbaf9ea34615a315'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:05.060372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2218bdf8ec1d4ababbaf9ea34615a315'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:05.073570 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1411/2836] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:16:04 2022] DELETE /identity/v3/users/2218bdf8ec1d4ababbaf9ea34615a315 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:05.078185 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a5d7-0e48-4f71-854d-92b076c564e2 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:05.078473 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a5d7-0e48-4f71-854d-92b076c564e2 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:05.078745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3820a5d7-0e48-4f71-854d-92b076c564e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:05.099726 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-3820a5d7-0e48-4f71-854d-92b076c564e2 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:05.100956 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3820a5d7-0e48-4f71-854d-92b076c564e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:05.164295 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1426/2837] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:05.174994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:05.176862 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:05.239538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc69f72-9022-4cef-81ca-baea90fd38e8 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:05.243671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8fac4b-3ad7-4fd2-9ab8-c8fb5f14c970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:05.244243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fac4b-3ad7-4fd2-9ab8-c8fb5f14c970 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:05.244538 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fac4b-3ad7-4fd2-9ab8-c8fb5f14c970 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:05.244806 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8fac4b-3ad7-4fd2-9ab8-c8fb5f14c970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:05.255860 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fac4b-3ad7-4fd2-9ab8-c8fb5f14c970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:05.258129 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8fac4b-3ad7-4fd2-9ab8-c8fb5f14c970 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:05.274922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1412/2838] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:05.568291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820a5d7-0e48-4f71-854d-92b076c564e2 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:05.569927 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-3820a5d7-0e48-4f71-854d-92b076c564e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:05.585418 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3820a5d7-0e48-4f71-854d-92b076c564e2 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:05.591168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:05.591831 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:05.592076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:05.592485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] PATH_INFO: `/v3/projects/d2b8bc9125d345fb8e7b9d57c757a08d` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:05.593485 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2b8bc9125d345fb8e7b9d57c757a08d)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:05.595406 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:05.643909 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2b8bc9125d345fb8e7b9d57c757a08d', 'request_id': 'req-3ed48b16-30a5-4c78-9194-3d6bc4729231'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:05.651767 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2b8bc9125d345fb8e7b9d57c757a08d', 'request_id': 'req-3ed48b16-30a5-4c78-9194-3d6bc4729231'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:05.664358 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2b8bc9125d345fb8e7b9d57c757a08d', 'request_id': 'req-3ed48b16-30a5-4c78-9194-3d6bc4729231'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:05.677454 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] The token cache is being invalidate because project d2b8bc9125d345fb8e7b9d57c757a08d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:16:05.677745 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:05.678470 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-3ed48b16-30a5-4c78-9194-3d6bc4729231 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:05.680084 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1427/2839] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:16:05 2022] DELETE /identity/v3/projects/d2b8bc9125d345fb8e7b9d57c757a08d => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:05.685039 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ed1c-ff30-4e4a-90ff-f8a27824d0fd None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:05.685566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ed1c-ff30-4e4a-90ff-f8a27824d0fd None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:05.685566 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c75ed1c-ff30-4e4a-90ff-f8a27824d0fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:05.709082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-2c75ed1c-ff30-4e4a-90ff-f8a27824d0fd None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:05.710294 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-2c75ed1c-ff30-4e4a-90ff-f8a27824d0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:05.728109 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:05.774283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1413/2840] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:05.782401 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658f5b4-7daa-4b2f-86d7-4410a87eec0c None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:05.782704 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658f5b4-7daa-4b2f-86d7-4410a87eec0c None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:05.782993 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658f5b4-7daa-4b2f-86d7-4410a87eec0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:05.805319 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-0658f5b4-7daa-4b2f-86d7-4410a87eec0c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:05.806519 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0658f5b4-7daa-4b2f-86d7-4410a87eec0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:05.816701 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1428/2841] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:05.820705 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ed1c-ff30-4e4a-90ff-f8a27824d0fd None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:05.831221 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c75ed1c-ff30-4e4a-90ff-f8a27824d0fd None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:05.836818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde58af-7915-4ead-9636-447982359025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:05.837431 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde58af-7915-4ead-9636-447982359025 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:05.837707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde58af-7915-4ead-9636-447982359025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:05.837978 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fde58af-7915-4ead-9636-447982359025 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:05.838663 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde58af-7915-4ead-9636-447982359025 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:16:05.839003 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde58af-7915-4ead-9636-447982359025 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:05.840688 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fde58af-7915-4ead-9636-447982359025 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:05.853303 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1414/2842] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:16:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:16:05.857749 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658f5b4-7daa-4b2f-86d7-4410a87eec0c None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:05.868042 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658f5b4-7daa-4b2f-86d7-4410a87eec0c None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:05.873294 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc022597-7877-4ee1-95c4-d835b2bbfe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:05.873896 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc022597-7877-4ee1-95c4-d835b2bbfe67 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:05.874172 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc022597-7877-4ee1-95c4-d835b2bbfe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:05.874439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc022597-7877-4ee1-95c4-d835b2bbfe67 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:05.875247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc022597-7877-4ee1-95c4-d835b2bbfe67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:05.877228 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc022597-7877-4ee1-95c4-d835b2bbfe67 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:05.910376 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1429/2843] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:16:05 2022] POST /identity/v3/projects => generated 399 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:16:05.914839 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde58af-7915-4ead-9636-447982359025 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:05.925490 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fde58af-7915-4ead-9636-447982359025 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:05.987944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2cbd3-4999-4fe8-aa07-40335b0d7e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:05.988543 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2cbd3-4999-4fe8-aa07-40335b0d7e78 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:05.988817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2cbd3-4999-4fe8-aa07-40335b0d7e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:05.989077 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e2cbd3-4999-4fe8-aa07-40335b0d7e78 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:05.989707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2cbd3-4999-4fe8-aa07-40335b0d7e78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:05.991681 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e2cbd3-4999-4fe8-aa07-40335b0d7e78 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:06.017512 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1415/2844] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:16:05 2022] POST /identity/v3/users => generated 300 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:16:06.022552 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc022597-7877-4ee1-95c4-d835b2bbfe67 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:06.037039 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc022597-7877-4ee1-95c4-d835b2bbfe67 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:06.041981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4078e3-e828-44dd-9bbc-d50e32c3024e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:06.042579 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4078e3-e828-44dd-9bbc-d50e32c3024e admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:06.042894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4078e3-e828-44dd-9bbc-d50e32c3024e admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:06.043168 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4078e3-e828-44dd-9bbc-d50e32c3024e admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:06.043917 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4078e3-e828-44dd-9bbc-d50e32c3024e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:06.045530 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4078e3-e828-44dd-9bbc-d50e32c3024e admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:06.058943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1430/2845] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:16:06.063015 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2cbd3-4999-4fe8-aa07-40335b0d7e78 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:06.073408 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e2cbd3-4999-4fe8-aa07-40335b0d7e78 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:06.078388 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f0a5c4-8572-4abe-8cf5-63fa442f4fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:06.079008 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0a5c4-8572-4abe-8cf5-63fa442f4fdb admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:06.079280 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0a5c4-8572-4abe-8cf5-63fa442f4fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:06.079552 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0a5c4-8572-4abe-8cf5-63fa442f4fdb admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:06.080220 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0a5c4-8572-4abe-8cf5-63fa442f4fdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:06.081915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f0a5c4-8572-4abe-8cf5-63fa442f4fdb admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:06.093652 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1416/2846] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:16:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:16:06.098232 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4078e3-e828-44dd-9bbc-d50e32c3024e admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:06.111810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4078e3-e828-44dd-9bbc-d50e32c3024e admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:06.120455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742472e6-9875-4ba7-bd54-a273d0d78b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:06.121490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742472e6-9875-4ba7-bd54-a273d0d78b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:06.121942 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742472e6-9875-4ba7-bd54-a273d0d78b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:06.122387 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742472e6-9875-4ba7-bd54-a273d0d78b5a admin admin] PATH_INFO: `/v3/projects/0417577af29447c6867b81b43960e2d4/users/02e14e5737fe4784ab7fecbbf6537942/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:06.141324 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742472e6-9875-4ba7-bd54-a273d0d78b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0417577af29447c6867b81b43960e2d4, user_id=02e14e5737fe4784ab7fecbbf6537942, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:06.144256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742472e6-9875-4ba7-bd54-a273d0d78b5a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:06.158869 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1431/2847] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:16:06 2022] PUT /identity/v3/projects/0417577af29447c6867b81b43960e2d4/users/02e14e5737fe4784ab7fecbbf6537942/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:06.171685 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8926b-0459-4122-8b54-6b58a0990183 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:06.171994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8926b-0459-4122-8b54-6b58a0990183 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:06.172258 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8926b-0459-4122-8b54-6b58a0990183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:06.207506 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-5ff8926b-0459-4122-8b54-6b58a0990183 None None] MFA Rules not processed for user `02e14e5737fe4784ab7fecbbf6537942`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:06.209235 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-5ff8926b-0459-4122-8b54-6b58a0990183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:06.293412 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1417/2848] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:06 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:06.305312 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742472e6-9875-4ba7-bd54-a273d0d78b5a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:06.307164 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-742472e6-9875-4ba7-bd54-a273d0d78b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:06.329439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:06.368156 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742472e6-9875-4ba7-bd54-a273d0d78b5a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:06.372590 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffd01d-ea1b-4be4-a23b-df476e6d8cd8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7b93049bc8aa47648d101a3f937ca8db', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:06.373204 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd01d-ea1b-4be4-a23b-df476e6d8cd8 service cinder] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:06.373487 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd01d-ea1b-4be4-a23b-df476e6d8cd8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:06.373761 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd01d-ea1b-4be4-a23b-df476e6d8cd8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:06.382796 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffd01d-ea1b-4be4-a23b-df476e6d8cd8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:06.384253 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ffd01d-ea1b-4be4-a23b-df476e6d8cd8 service cinder] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:06.393944 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1432/2849] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:06 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:14.635990 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8926b-0459-4122-8b54-6b58a0990183 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:14.660108 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:14.708840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8926b-0459-4122-8b54-6b58a0990183 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:14.714007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:14.714625 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:14.714938 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:14.715192 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] PATH_INFO: `/v3/users/02e14e5737fe4784ab7fecbbf6537942` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:14.716374 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02e14e5737fe4784ab7fecbbf6537942)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:14.718320 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:14.774867 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02e14e5737fe4784ab7fecbbf6537942'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:14.775569 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02e14e5737fe4784ab7fecbbf6537942'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:14.776186 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02e14e5737fe4784ab7fecbbf6537942'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:14.789554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02e14e5737fe4784ab7fecbbf6537942'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:14.799747 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02e14e5737fe4784ab7fecbbf6537942'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:14.813072 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1418/2850] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:16:14 2022] DELETE /identity/v3/users/02e14e5737fe4784ab7fecbbf6537942 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:14.817910 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e08859-0ec3-4a32-9532-5faade1862e8 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:14.818391 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e08859-0ec3-4a32-9532-5faade1862e8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:14.818507 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e08859-0ec3-4a32-9532-5faade1862e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:14.837875 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-20e08859-0ec3-4a32-9532-5faade1862e8 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:14.840520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-20e08859-0ec3-4a32-9532-5faade1862e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:14.917427 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1433/2851] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:14.927986 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:14.930243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:14.998029 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453ebfcd-bd6a-4bb9-baff-8c4205e1af23 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:15.002172 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bc3c71-3ee6-4671-9f68-e0e6ac2a7b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:15.002914 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3c71-3ee6-4671-9f68-e0e6ac2a7b71 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.003182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3c71-3ee6-4671-9f68-e0e6ac2a7b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.003457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bc3c71-3ee6-4671-9f68-e0e6ac2a7b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.018943 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc3c71-3ee6-4671-9f68-e0e6ac2a7b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:15.021454 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bc3c71-3ee6-4671-9f68-e0e6ac2a7b71 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:15.035936 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1419/2852] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:15.344919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e08859-0ec3-4a32-9532-5faade1862e8 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:15.346672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-20e08859-0ec3-4a32-9532-5faade1862e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:15.360727 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e08859-0ec3-4a32-9532-5faade1862e8 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:15.366915 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:15.367668 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.367847 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.368149 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] PATH_INFO: `/v3/projects/0417577af29447c6867b81b43960e2d4` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.369263 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0417577af29447c6867b81b43960e2d4)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:15.371234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:15.419823 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0417577af29447c6867b81b43960e2d4', 'request_id': 'req-b312ceb7-5640-41d8-80d4-afea043ff538'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:15.425889 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0417577af29447c6867b81b43960e2d4', 'request_id': 'req-b312ceb7-5640-41d8-80d4-afea043ff538'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:15.434870 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0417577af29447c6867b81b43960e2d4', 'request_id': 'req-b312ceb7-5640-41d8-80d4-afea043ff538'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:15.446520 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] The token cache is being invalidate because project 0417577af29447c6867b81b43960e2d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81587) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:16:15.446813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:15.447558 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-b312ceb7-5640-41d8-80d4-afea043ff538 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:15.449194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1434/2853] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:16:15 2022] DELETE /identity/v3/projects/0417577af29447c6867b81b43960e2d4 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:15.454288 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c497-ccb0-4eff-949e-f31419365a64 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.454554 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c497-ccb0-4eff-949e-f31419365a64 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.454827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054c497-ccb0-4eff-949e-f31419365a64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.475285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-a054c497-ccb0-4eff-949e-f31419365a64 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:15.476651 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-a054c497-ccb0-4eff-949e-f31419365a64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:15.516387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:15.554908 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1420/2854] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:15.563250 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234b9d8-82bb-489c-a9b3-57d35d3da5c7 None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.563543 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234b9d8-82bb-489c-a9b3-57d35d3da5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.563820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4234b9d8-82bb-489c-a9b3-57d35d3da5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.587348 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-4234b9d8-82bb-489c-a9b3-57d35d3da5c7 None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:15.588588 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-4234b9d8-82bb-489c-a9b3-57d35d3da5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:15.597523 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1435/2855] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:15.602498 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c497-ccb0-4eff-949e-f31419365a64 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:15.617945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054c497-ccb0-4eff-949e-f31419365a64 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:15.626671 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff7a89-8f18-4352-b7e7-9531025ebf75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:15.627640 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff7a89-8f18-4352-b7e7-9531025ebf75 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.627915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff7a89-8f18-4352-b7e7-9531025ebf75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.628180 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ff7a89-8f18-4352-b7e7-9531025ebf75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.628827 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff7a89-8f18-4352-b7e7-9531025ebf75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81586) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 18 21:16:15.629126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff7a89-8f18-4352-b7e7-9531025ebf75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:15.630725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ff7a89-8f18-4352-b7e7-9531025ebf75 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:15.644429 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1421/2856] 10.222.0.59 () {58 vars in 1153 bytes} [Thu Aug 18 21:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 18 21:16:15.650302 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234b9d8-82bb-489c-a9b3-57d35d3da5c7 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:15.660555 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4234b9d8-82bb-489c-a9b3-57d35d3da5c7 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:15.666458 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68c2a-62ad-44d5-aeec-f8b8e1156f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:15.667140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68c2a-62ad-44d5-aeec-f8b8e1156f31 admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.667416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68c2a-62ad-44d5-aeec-f8b8e1156f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.667687 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f68c2a-62ad-44d5-aeec-f8b8e1156f31 admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.668311 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f68c2a-62ad-44d5-aeec-f8b8e1156f31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:15.670227 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f68c2a-62ad-44d5-aeec-f8b8e1156f31 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:15.705943 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1436/2857] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:16:15 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:16:15.713563 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff7a89-8f18-4352-b7e7-9531025ebf75 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:15.726644 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ff7a89-8f18-4352-b7e7-9531025ebf75 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:15.789632 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70042406-a121-482b-9359-673244890440 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:15.790255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70042406-a121-482b-9359-673244890440 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.790534 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70042406-a121-482b-9359-673244890440 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.790805 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70042406-a121-482b-9359-673244890440 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.791475 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70042406-a121-482b-9359-673244890440 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:15.793428 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70042406-a121-482b-9359-673244890440 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:15.821063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1422/2858] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:16:15 2022] POST /identity/v3/users => generated 287 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:16:15.822497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68c2a-62ad-44d5-aeec-f8b8e1156f31 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:15.833814 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f68c2a-62ad-44d5-aeec-f8b8e1156f31 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:15.838692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f7bb8-b064-4dfd-af80-1085282f89f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:15.839344 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f7bb8-b064-4dfd-af80-1085282f89f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.839617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f7bb8-b064-4dfd-af80-1085282f89f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.839888 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f7bb8-b064-4dfd-af80-1085282f89f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.840531 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f7bb8-b064-4dfd-af80-1085282f89f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:15.842162 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d6f7bb8-b064-4dfd-af80-1085282f89f5 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:15.852563 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1437/2859] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:16:15.856692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70042406-a121-482b-9359-673244890440 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:15.867193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70042406-a121-482b-9359-673244890440 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:15.872437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c334e-5fcc-4351-8938-7984a1d783d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:15.873032 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c334e-5fcc-4351-8938-7984a1d783d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.873328 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c334e-5fcc-4351-8938-7984a1d783d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.873590 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c334e-5fcc-4351-8938-7984a1d783d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.874232 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c334e-5fcc-4351-8938-7984a1d783d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:15.875901 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c334e-5fcc-4351-8938-7984a1d783d9 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:15.887439 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1423/2860] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:16:15.892064 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f7bb8-b064-4dfd-af80-1085282f89f5 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:15.902908 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f7bb8-b064-4dfd-af80-1085282f89f5 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:15.908665 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66106339-89f2-4539-a35d-5e8b2538faa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:15.909317 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66106339-89f2-4539-a35d-5e8b2538faa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.909592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66106339-89f2-4539-a35d-5e8b2538faa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.909857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66106339-89f2-4539-a35d-5e8b2538faa8 admin admin] PATH_INFO: `/v3/projects/5e04e1ca61c448918ad13af0d72320d9/users/1da9b695ec414dce9377c4227348cc8c/roles/fc85aab66ae3471dbebf6a8340dbd444` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.912339 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:15.928758 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66106339-89f2-4539-a35d-5e8b2538faa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e04e1ca61c448918ad13af0d72320d9, user_id=1da9b695ec414dce9377c4227348cc8c, role_id=fc85aab66ae3471dbebf6a8340dbd444)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:15.931855 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66106339-89f2-4539-a35d-5e8b2538faa8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:15.948800 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1438/2861] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:16:15 2022] PUT /identity/v3/projects/5e04e1ca61c448918ad13af0d72320d9/users/1da9b695ec414dce9377c4227348cc8c/roles/fc85aab66ae3471dbebf6a8340dbd444 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:15.953922 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa3126-2d27-44f8-8740-e8439b70ab6c None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:15.954206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa3126-2d27-44f8-8740-e8439b70ab6c None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:15.954480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fa3126-2d27-44f8-8740-e8439b70ab6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:15.976239 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-76fa3126-2d27-44f8-8740-e8439b70ab6c None None] MFA Rules not processed for user `6f68b08e3d424c04b847f9123ed23bfd`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:15.977465 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-76fa3126-2d27-44f8-8740-e8439b70ab6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:16.040823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1424/2862] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:16.053048 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66106339-89f2-4539-a35d-5e8b2538faa8 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:16.054828 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-66106339-89f2-4539-a35d-5e8b2538faa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:16.113536 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66106339-89f2-4539-a35d-5e8b2538faa8 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:16.117805 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcdc9d-e774-4865-895d-4a7257d852c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:16.118416 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcdc9d-e774-4865-895d-4a7257d852c2 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:16.118692 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcdc9d-e774-4865-895d-4a7257d852c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:16.118992 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bcdc9d-e774-4865-895d-4a7257d852c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:16.128421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcdc9d-e774-4865-895d-4a7257d852c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:16.129857 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bcdc9d-e774-4865-895d-4a7257d852c2 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:16.140049 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1439/2863] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:20.749146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18656-ac9f-41fb-82c8-c63f7fd9ee7a None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:20.749687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18656-ac9f-41fb-82c8-c63f7fd9ee7a None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:20.749687 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a18656-ac9f-41fb-82c8-c63f7fd9ee7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:20.786899 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-09a18656-ac9f-41fb-82c8-c63f7fd9ee7a None None] MFA Rules not processed for user `1da9b695ec414dce9377c4227348cc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:20.788260 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-09a18656-ac9f-41fb-82c8-c63f7fd9ee7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:20.828286 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:20.871553 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1425/2864] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:20.872884 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcdc9d-e774-4865-895d-4a7257d852c2 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:20.883369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bcdc9d-e774-4865-895d-4a7257d852c2 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:20.888368 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef349b-d90f-452e-b215-00263dc4823a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:20.889452 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef349b-d90f-452e-b215-00263dc4823a admin admin] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:20.889731 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef349b-d90f-452e-b215-00263dc4823a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:20.889998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ef349b-d90f-452e-b215-00263dc4823a admin admin] PATH_INFO: `/v3/projects` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:20.890667 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef349b-d90f-452e-b215-00263dc4823a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:20.893194 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ef349b-d90f-452e-b215-00263dc4823a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:20.924480 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1440/2865] 10.222.0.59 () {60 vars in 1153 bytes} [Thu Aug 18 21:16:20 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 18 21:16:20.931858 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18656-ac9f-41fb-82c8-c63f7fd9ee7a None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:20.946031 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a18656-ac9f-41fb-82c8-c63f7fd9ee7a None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:21.006859 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cab57-f0e6-4d02-94f1-ebaf8c7d3e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:21.007510 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cab57-f0e6-4d02-94f1-ebaf8c7d3e11 admin admin] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:21.007797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cab57-f0e6-4d02-94f1-ebaf8c7d3e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:21.008076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478cab57-f0e6-4d02-94f1-ebaf8c7d3e11 admin admin] PATH_INFO: `/v3/users` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:21.008692 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cab57-f0e6-4d02-94f1-ebaf8c7d3e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:21.010746 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478cab57-f0e6-4d02-94f1-ebaf8c7d3e11 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:21.037815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1426/2866] 10.222.0.59 () {60 vars in 1144 bytes} [Thu Aug 18 21:16:20 2022] POST /identity/v3/users => generated 293 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 18 21:16:21.041618 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef349b-d90f-452e-b215-00263dc4823a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:21.052477 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ef349b-d90f-452e-b215-00263dc4823a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:21.057592 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57709646-ccec-478e-9994-228a7599f3cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:21.058211 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57709646-ccec-478e-9994-228a7599f3cb admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:21.058490 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57709646-ccec-478e-9994-228a7599f3cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:21.058759 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57709646-ccec-478e-9994-228a7599f3cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:21.059447 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57709646-ccec-478e-9994-228a7599f3cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:21.061082 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57709646-ccec-478e-9994-228a7599f3cb admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:21.074820 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1441/2867] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:16:21.076855 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cab57-f0e6-4d02-94f1-ebaf8c7d3e11 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:21.087519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478cab57-f0e6-4d02-94f1-ebaf8c7d3e11 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:21.092677 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21301-65c2-4fc5-8f79-b7a7837f2da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:21.093468 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21301-65c2-4fc5-8f79-b7a7837f2da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:21.093638 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21301-65c2-4fc5-8f79-b7a7837f2da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:21.093885 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb21301-65c2-4fc5-8f79-b7a7837f2da7 admin admin] PATH_INFO: `/v3/projects/82922a34d20e423aaad0475cbe52b759/users/7b196a5c76374336bca64646a44f29ad/roles/85a146946817410b9a3addcf041c5909` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:21.111945 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb21301-65c2-4fc5-8f79-b7a7837f2da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82922a34d20e423aaad0475cbe52b759, user_id=7b196a5c76374336bca64646a44f29ad, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:21.115000 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb21301-65c2-4fc5-8f79-b7a7837f2da7 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:21.132953 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1427/2868] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:16:21 2022] PUT /identity/v3/projects/82922a34d20e423aaad0475cbe52b759/users/7b196a5c76374336bca64646a44f29ad/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:21.136722 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57709646-ccec-478e-9994-228a7599f3cb admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:21.151025 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57709646-ccec-478e-9994-228a7599f3cb admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:21.217261 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308df098-2ef6-4c60-af94-d327381db2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:21.218046 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df098-2ef6-4c60-af94-d327381db2f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:21.218235 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df098-2ef6-4c60-af94-d327381db2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:21.218481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308df098-2ef6-4c60-af94-d327381db2f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:21.219388 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308df098-2ef6-4c60-af94-d327381db2f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:21.220976 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308df098-2ef6-4c60-af94-d327381db2f5 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:21.246136 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21301-65c2-4fc5-8f79-b7a7837f2da7 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:21.248296 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-cfb21301-65c2-4fc5-8f79-b7a7837f2da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:21.259421 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1442/2869] 10.222.0.59 () {58 vars in 1122 bytes} [Thu Aug 18 21:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 18 21:16:21.265975 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308df098-2ef6-4c60-af94-d327381db2f5 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:21.282319 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308df098-2ef6-4c60-af94-d327381db2f5 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:21.303990 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85176e95-c860-416c-84d9-bc8c1017741c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:21.305297 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85176e95-c860-416c-84d9-bc8c1017741c admin admin] REQUEST_METHOD: `PUT` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:21.305404 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85176e95-c860-416c-84d9-bc8c1017741c admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:21.305810 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85176e95-c860-416c-84d9-bc8c1017741c admin admin] PATH_INFO: `/v3/projects/82922a34d20e423aaad0475cbe52b759/users/7b196a5c76374336bca64646a44f29ad/roles/85a146946817410b9a3addcf041c5909` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:21.308394 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85176e95-c860-416c-84d9-bc8c1017741c admin admin] RBAC: Authorizing `identity:create_grant(project_id=82922a34d20e423aaad0475cbe52b759, user_id=7b196a5c76374336bca64646a44f29ad, role_id=85a146946817410b9a3addcf041c5909)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:21.312923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85176e95-c860-416c-84d9-bc8c1017741c admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:21.339584 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1443/2870] 10.222.0.59 () {60 vars in 1483 bytes} [Thu Aug 18 21:16:21 2022] PUT /identity/v3/projects/82922a34d20e423aaad0475cbe52b759/users/7b196a5c76374336bca64646a44f29ad/roles/85a146946817410b9a3addcf041c5909 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:21.529013 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb21301-65c2-4fc5-8f79-b7a7837f2da7 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:21.562890 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:21.572948 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85176e95-c860-416c-84d9-bc8c1017741c admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:21.575552 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-85176e95-c860-416c-84d9-bc8c1017741c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:21.655063 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f8653-ba28-43e9-93e8-8fcb48c5228b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:21.655750 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f8653-ba28-43e9-93e8-8fcb48c5228b service nova] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:21.656519 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f8653-ba28-43e9-93e8-8fcb48c5228b service nova] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:21.656803 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f8653-ba28-43e9-93e8-8fcb48c5228b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:21.659757 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-aa2f8653-ba28-43e9-93e8-8fcb48c5228b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:21.668399 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:21.679707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f8653-ba28-43e9-93e8-8fcb48c5228b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:21.681548 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2f8653-ba28-43e9-93e8-8fcb48c5228b service nova] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:21.695280 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85176e95-c860-416c-84d9-bc8c1017741c admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:21.695799 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1428/2871] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 18 21:16:21.700754 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea250e-108c-4532-b654-4e261c4216f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:21.701518 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea250e-108c-4532-b654-4e261c4216f9 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:21.702267 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea250e-108c-4532-b654-4e261c4216f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:21.702548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ea250e-108c-4532-b654-4e261c4216f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:21.705119 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-76ea250e-108c-4532-b654-4e261c4216f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:21.736486 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea250e-108c-4532-b654-4e261c4216f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:21.739621 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ea250e-108c-4532-b654-4e261c4216f9 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:21.759951 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1444/2872] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:22.523491 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f8653-ba28-43e9-93e8-8fcb48c5228b service nova] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:22.539944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f8653-ba28-43e9-93e8-8fcb48c5228b service nova] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:22.549447 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8e081d-1ba0-4a86-87da-0ed912e41ca2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:22.550226 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e081d-1ba0-4a86-87da-0ed912e41ca2 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:22.550571 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e081d-1ba0-4a86-87da-0ed912e41ca2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:22.550994 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8e081d-1ba0-4a86-87da-0ed912e41ca2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:22.553206 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0d8e081d-1ba0-4a86-87da-0ed912e41ca2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:22.568335 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e081d-1ba0-4a86-87da-0ed912e41ca2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:22.571472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8e081d-1ba0-4a86-87da-0ed912e41ca2 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:22.583372 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1429/2873] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:23.034285 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea250e-108c-4532-b654-4e261c4216f9 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:23.047799 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ea250e-108c-4532-b654-4e261c4216f9 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:23.060653 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861189d-d599-4fc3-b618-3e5f2f6b15bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:23.061282 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861189d-d599-4fc3-b618-3e5f2f6b15bf service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:23.061556 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861189d-d599-4fc3-b618-3e5f2f6b15bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:23.061824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b861189d-d599-4fc3-b618-3e5f2f6b15bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:23.067846 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-b861189d-d599-4fc3-b618-3e5f2f6b15bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:23.095809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861189d-d599-4fc3-b618-3e5f2f6b15bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:23.097542 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b861189d-d599-4fc3-b618-3e5f2f6b15bf service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:23.129998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1445/2874] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:26.631691 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc16276-383a-4aca-95d5-adc5bdb4568f None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:26.632255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc16276-383a-4aca-95d5-adc5bdb4568f None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:26.632255 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc16276-383a-4aca-95d5-adc5bdb4568f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:26.662051 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-0bc16276-383a-4aca-95d5-adc5bdb4568f None None] MFA Rules not processed for user `7b196a5c76374336bca64646a44f29ad`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:26.663266 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0bc16276-383a-4aca-95d5-adc5bdb4568f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:26.739126 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1430/2875] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:26 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:26.753218 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861189d-d599-4fc3-b618-3e5f2f6b15bf service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:26.764998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b861189d-d599-4fc3-b618-3e5f2f6b15bf service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:26.771085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352b51b-ed95-4fe5-b598-4b8b108d41af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:26.771707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352b51b-ed95-4fe5-b598-4b8b108d41af service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:26.771981 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352b51b-ed95-4fe5-b598-4b8b108d41af service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:26.772247 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a352b51b-ed95-4fe5-b598-4b8b108d41af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:26.828036 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352b51b-ed95-4fe5-b598-4b8b108d41af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:26.829639 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a352b51b-ed95-4fe5-b598-4b8b108d41af service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:26.838899 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1446/2876] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:26 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:27.920775 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a76bc0-77cc-4c13-aa3c-cab334a5f387 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:27.921443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a76bc0-77cc-4c13-aa3c-cab334a5f387 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:27.921443 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a76bc0-77cc-4c13-aa3c-cab334a5f387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:27.941859 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-68a76bc0-77cc-4c13-aa3c-cab334a5f387 None None] MFA Rules not processed for user `1da9b695ec414dce9377c4227348cc8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:16:27.943139 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-68a76bc0-77cc-4c13-aa3c-cab334a5f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:27.950955 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1431/2877] 10.222.0.59 () {58 vars in 958 bytes} [Thu Aug 18 21:16:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:16:35.266439 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352b51b-ed95-4fe5-b598-4b8b108d41af service nova] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:35.277429 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a352b51b-ed95-4fe5-b598-4b8b108d41af service nova] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:35.281874 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eb2ad-4bb2-432c-8b84-5980a0ba3c3a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:35.282628 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb2ad-4bb2-432c-8b84-5980a0ba3c3a service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:35.282998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb2ad-4bb2-432c-8b84-5980a0ba3c3a service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:35.283320 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394eb2ad-4bb2-432c-8b84-5980a0ba3c3a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:35.285471 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-394eb2ad-4bb2-432c-8b84-5980a0ba3c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:35.355147 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394eb2ad-4bb2-432c-8b84-5980a0ba3c3a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:35.356522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394eb2ad-4bb2-432c-8b84-5980a0ba3c3a service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:35.367709 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1447/2878] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:37.936025 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=68 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:38.404371 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a76bc0-77cc-4c13-aa3c-cab334a5f387 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:38.405818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-68a76bc0-77cc-4c13-aa3c-cab334a5f387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:38.494150 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a76bc0-77cc-4c13-aa3c-cab334a5f387 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:38.502528 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e613b07-7002-4e69-8999-a7805cafb1f0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:38.503285 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613b07-7002-4e69-8999-a7805cafb1f0 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:38.503984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613b07-7002-4e69-8999-a7805cafb1f0 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:38.503984 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e613b07-7002-4e69-8999-a7805cafb1f0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:38.506298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-8e613b07-7002-4e69-8999-a7805cafb1f0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:38.519821 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e613b07-7002-4e69-8999-a7805cafb1f0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:38.521661 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e613b07-7002-4e69-8999-a7805cafb1f0 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:38.532894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1432/2879] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:38 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:41.971819 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eb2ad-4bb2-432c-8b84-5980a0ba3c3a service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:41.974834 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-394eb2ad-4bb2-432c-8b84-5980a0ba3c3a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:41.988111 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394eb2ad-4bb2-432c-8b84-5980a0ba3c3a service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:41.993938 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:41.994581 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:41.995058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:41.995331 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] PATH_INFO: `/v3/users/bfe3817d4e7241e689e6ecc095e938ca` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:41.996596 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe3817d4e7241e689e6ecc095e938ca)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:41.998553 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:42.050234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe3817d4e7241e689e6ecc095e938ca'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.054936 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:42.063860 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe3817d4e7241e689e6ecc095e938ca'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.072166 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe3817d4e7241e689e6ecc095e938ca'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.078998 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe3817d4e7241e689e6ecc095e938ca'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.079629 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe3817d4e7241e689e6ecc095e938ca'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.085492 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1448/2880] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:16:41 2022] DELETE /identity/v3/users/bfe3817d4e7241e689e6ecc095e938ca => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:42.285647 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e613b07-7002-4e69-8999-a7805cafb1f0 service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:42.301466 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e613b07-7002-4e69-8999-a7805cafb1f0 service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:42.362450 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:42.363135 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:42.363397 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:42.363665 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] PATH_INFO: `/v3/projects/f714a6967cf34288a66d8cc0c328a147` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:42.364898 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f714a6967cf34288a66d8cc0c328a147)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:42.366818 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:42.415728 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f714a6967cf34288a66d8cc0c328a147', 'request_id': 'req-80f582c2-d794-405f-8539-3e6586acec83'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.425048 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f714a6967cf34288a66d8cc0c328a147', 'request_id': 'req-80f582c2-d794-405f-8539-3e6586acec83'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.431437 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f714a6967cf34288a66d8cc0c328a147', 'request_id': 'req-80f582c2-d794-405f-8539-3e6586acec83'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.441788 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] The token cache is being invalidate because project f714a6967cf34288a66d8cc0c328a147 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:16:42.442074 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.442696 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.444503 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1433/2881] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:16:42 2022] DELETE /identity/v3/projects/f714a6967cf34288a66d8cc0c328a147 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:42.448509 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:42.450058 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:42.464130 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7078aab-2458-41cd-af87-64cbf8ef51a8 admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:42.521989 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:42.522615 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:42.522923 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:42.523197 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] PATH_INFO: `/v3/users/e1ef01e683554fad9e72130fbfcbddce` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:42.524377 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ef01e683554fad9e72130fbfcbddce)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:42.526351 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:42.582161 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ef01e683554fad9e72130fbfcbddce'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.599371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ef01e683554fad9e72130fbfcbddce'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.608234 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ef01e683554fad9e72130fbfcbddce'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.616015 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ef01e683554fad9e72130fbfcbddce'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.616797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ef01e683554fad9e72130fbfcbddce'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.622673 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1449/2882] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:16:42 2022] DELETE /identity/v3/users/e1ef01e683554fad9e72130fbfcbddce => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:42.803981 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:42.805544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:42.819875 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f582c2-d794-405f-8539-3e6586acec83 admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:42.838182 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:42.884492 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:42.885134 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:42.885409 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:42.885655 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] PATH_INFO: `/v3/projects/4a71f281cc384b0280e9165ec8d59d34` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:42.886800 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4a71f281cc384b0280e9165ec8d59d34)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:42.889082 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:42.937376 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4a71f281cc384b0280e9165ec8d59d34', 'request_id': 'req-0c82082e-712f-432a-b572-19a4956ac01d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.947214 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4a71f281cc384b0280e9165ec8d59d34', 'request_id': 'req-0c82082e-712f-432a-b572-19a4956ac01d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.953445 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4a71f281cc384b0280e9165ec8d59d34', 'request_id': 'req-0c82082e-712f-432a-b572-19a4956ac01d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.963797 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] The token cache is being invalidate because project 4a71f281cc384b0280e9165ec8d59d34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:16:42.964076 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.964706 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:16:42.966201 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1434/2883] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:16:42 2022] DELETE /identity/v3/projects/4a71f281cc384b0280e9165ec8d59d34 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:16:43.631733 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:43.633225 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:43.687995 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:43.692456 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5bfb260-773e-4631-8be0-253471cc138a admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:43.750647 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034c158-d09a-4487-b425-3344e3ea7603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:43.751334 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c158-d09a-4487-b425-3344e3ea7603 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:43.751617 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c158-d09a-4487-b425-3344e3ea7603 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:43.751890 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7034c158-d09a-4487-b425-3344e3ea7603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:43.753919 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7034c158-d09a-4487-b425-3344e3ea7603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:43.764987 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034c158-d09a-4487-b425-3344e3ea7603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:43.766468 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7034c158-d09a-4487-b425-3344e3ea7603 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:43.775293 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1450/2884] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:44.294678 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:44.296248 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:44.377071 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c82082e-712f-432a-b572-19a4956ac01d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:44.382524 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba840660-13f0-476b-8631-d1ba7a67cb34 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:44.383175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba840660-13f0-476b-8631-d1ba7a67cb34 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:44.383457 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba840660-13f0-476b-8631-d1ba7a67cb34 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:44.383707 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba840660-13f0-476b-8631-d1ba7a67cb34 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:44.385486 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ba840660-13f0-476b-8631-d1ba7a67cb34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:44.397733 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba840660-13f0-476b-8631-d1ba7a67cb34 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:44.399405 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba840660-13f0-476b-8631-d1ba7a67cb34 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:44.409544 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1435/2885] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:16:53.771155 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=24 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:54.405606 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:16:58.164379 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034c158-d09a-4487-b425-3344e3ea7603 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:16:58.166055 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7034c158-d09a-4487-b425-3344e3ea7603 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:58.244705 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7034c158-d09a-4487-b425-3344e3ea7603 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:16:58.250809 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b6a2c-2bfa-4d72-aaf9-91936b4c5556 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:16:58.251419 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b6a2c-2bfa-4d72-aaf9-91936b4c5556 service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:16:58.251694 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b6a2c-2bfa-4d72-aaf9-91936b4c5556 service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:16:58.251959 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b6a2c-2bfa-4d72-aaf9-91936b4c5556 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:16:58.253714 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-743b6a2c-2bfa-4d72-aaf9-91936b4c5556 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:16:58.266465 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b6a2c-2bfa-4d72-aaf9-91936b4c5556 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:16:58.268087 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b6a2c-2bfa-4d72-aaf9-91936b4c5556 service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:16:58.278747 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1451/2886] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:16:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:17:01.248193 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba840660-13f0-476b-8631-d1ba7a67cb34 service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:17:01.250304 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ba840660-13f0-476b-8631-d1ba7a67cb34 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:17:01.268344 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba840660-13f0-476b-8631-d1ba7a67cb34 service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:17:01.272826 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026198-cbcc-4306-b5eb-fd2bd6995033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:17:01.273418 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026198-cbcc-4306-b5eb-fd2bd6995033 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:17:01.273699 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026198-cbcc-4306-b5eb-fd2bd6995033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:17:01.273969 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3026198-cbcc-4306-b5eb-fd2bd6995033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:17:01.276112 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b3026198-cbcc-4306-b5eb-fd2bd6995033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:17:01.357823 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026198-cbcc-4306-b5eb-fd2bd6995033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:17:01.359354 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3026198-cbcc-4306-b5eb-fd2bd6995033 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:17:01.369795 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1436/2887] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:17:01 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:17:03.268774 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b6a2c-2bfa-4d72-aaf9-91936b4c5556 service nova] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:17:03.270352 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-743b6a2c-2bfa-4d72-aaf9-91936b4c5556 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:17:03.286574 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b6a2c-2bfa-4d72-aaf9-91936b4c5556 service nova] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:17:03.293533 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc72e4-e845-48a8-8e60-93223b5ecd8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c6ceb08f9eda4942a510bfaa0f0ef84e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:17:03.294233 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc72e4-e845-48a8-8e60-93223b5ecd8d service nova] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:17:03.294576 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc72e4-e845-48a8-8e60-93223b5ecd8d service nova] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:17:03.294844 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdc72e4-e845-48a8-8e60-93223b5ecd8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:17:03.297016 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-fbdc72e4-e845-48a8-8e60-93223b5ecd8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:17:03.311283 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc72e4-e845-48a8-8e60-93223b5ecd8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:17:03.313532 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdc72e4-e845-48a8-8e60-93223b5ecd8d service nova] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:17:03.325763 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1452/2888] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:17:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:17:11.364770 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=30 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:17:13.320132 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=40 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:18:52.105146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026198-cbcc-4306-b5eb-fd2bd6995033 service neutron] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:18:52.117496 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3026198-cbcc-4306-b5eb-fd2bd6995033 service neutron] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:18:52.123869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216f20e-afde-49ec-a881-fc83cc142b15 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:18:52.124472 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f20e-afde-49ec-a881-fc83cc142b15 service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:18:52.124725 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f20e-afde-49ec-a881-fc83cc142b15 service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:18:52.125007 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216f20e-afde-49ec-a881-fc83cc142b15 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:18:52.127246 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-3216f20e-afde-49ec-a881-fc83cc142b15 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:18:52.141283 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216f20e-afde-49ec-a881-fc83cc142b15 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:18:52.142915 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216f20e-afde-49ec-a881-fc83cc142b15 service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:18:52.154209 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1437/2889] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:18:52 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:02.149480 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=6 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:19:12.166551 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc72e4-e845-48a8-8e60-93223b5ecd8d service nova] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:19:12.177497 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdc72e4-e845-48a8-8e60-93223b5ecd8d service nova] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:19:12.181138 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c0262-7c19-40fc-85fc-e09d09524c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:19:12.181778 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c0262-7c19-40fc-85fc-e09d09524c2f service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:12.182050 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c0262-7c19-40fc-85fc-e09d09524c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:12.182342 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c0262-7c19-40fc-85fc-e09d09524c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:12.184085 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-027c0262-7c19-40fc-85fc-e09d09524c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:19:12.194024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c0262-7c19-40fc-85fc-e09d09524c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:19:12.195511 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c0262-7c19-40fc-85fc-e09d09524c2f service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:19:12.203816 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1453/2890] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:19:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:12.340146 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703150-e630-4ef9-a12a-0577a3d44145 None None] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:12.341110 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703150-e630-4ef9-a12a-0577a3d44145 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:12.341387 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3703150-e630-4ef9-a12a-0577a3d44145 None None] PATH_INFO: `/` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:12.342944 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1438/2891] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 21:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:19:12.349818 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719386-97bf-453a-ad6e-678b8bc3e78a None None] REQUEST_METHOD: `POST` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:12.350076 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719386-97bf-453a-ad6e-678b8bc3e78a None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:12.350361 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f719386-97bf-453a-ad6e-678b8bc3e78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:12.399614 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.auth.core [None req-7f719386-97bf-453a-ad6e-678b8bc3e78a None None] MFA Rules not processed for user `309ebac21dd944029b1de80ba54dd794`. Rule list: `[]` (Enabled: `True`). {{(pid=81587) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:19:12.400894 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-7f719386-97bf-453a-ad6e-678b8bc3e78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:19:12.408984 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1454/2892] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:19:12.421814 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3703150-e630-4ef9-a12a-0577a3d44145 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:19:12.424021 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-e3703150-e630-4ef9-a12a-0577a3d44145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:19:12.439958 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3703150-e630-4ef9-a12a-0577a3d44145 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:19:12.443815 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac13ca4e-9849-41ac-b802-63b93de8b6a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:19:12.444579 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13ca4e-9849-41ac-b802-63b93de8b6a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:12.444919 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13ca4e-9849-41ac-b802-63b93de8b6a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:12.445269 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13ca4e-9849-41ac-b802-63b93de8b6a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:12.454257 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13ca4e-9849-41ac-b802-63b93de8b6a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:19:12.455879 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac13ca4e-9849-41ac-b802-63b93de8b6a8 service neutron] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:19:12.465153 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1439/2893] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:19:12 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:12.578278 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14845-be8c-4ce8-bb9c-b53cc568ffa8 None None] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:12.578764 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14845-be8c-4ce8-bb9c-b53cc568ffa8 None None] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:12.579256 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be14845-be8c-4ce8-bb9c-b53cc568ffa8 None None] PATH_INFO: `/` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:12.581157 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1455/2894] 10.222.0.59 () {54 vars in 921 bytes} [Thu Aug 18 21:19:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 18 21:19:12.586894 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef21e0-ee73-4f20-981c-58821f145f22 None None] REQUEST_METHOD: `POST` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:12.587184 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef21e0-ee73-4f20-981c-58821f145f22 None None] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:12.587507 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef21e0-ee73-4f20-981c-58821f145f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:12.628592 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.auth.core [None req-dfef21e0-ee73-4f20-981c-58821f145f22 None None] MFA Rules not processed for user `c6ceb08f9eda4942a510bfaa0f0ef84e`. Rule list: `[]` (Enabled: `True`). {{(pid=81586) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 18 21:19:12.629832 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-dfef21e0-ee73-4f20-981c-58821f145f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:19:12.641292 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1440/2895] 10.222.0.59 () {58 vars in 1018 bytes} [Thu Aug 18 21:19:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 18 21:19:12.652237 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14845-be8c-4ce8-bb9c-b53cc568ffa8 None None] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:19:12.663813 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be14845-be8c-4ce8-bb9c-b53cc568ffa8 None None] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:19:12.667947 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd556466-abd2-4560-bdf1-51ee3a590674 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '309ebac21dd944029b1de80ba54dd794', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:19:12.668548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd556466-abd2-4560-bdf1-51ee3a590674 service neutron] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:19:12.668824 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd556466-abd2-4560-bdf1-51ee3a590674 service neutron] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:19:12.669094 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd556466-abd2-4560-bdf1-51ee3a590674 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:19:12.679353 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd556466-abd2-4560-bdf1-51ee3a590674 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:19:12.680797 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd556466-abd2-4560-bdf1-51ee3a590674 service neutron] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:19:12.691835 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1456/2896] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:19:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:19:22.625700 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=15 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:19:22.687219 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=21 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:20:45.746195 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef21e0-ee73-4f20-981c-58821f145f22 None None] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:20:45.770298 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef21e0-ee73-4f20-981c-58821f145f22 None None] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:20:45.785378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a8295-2d07-4757-8ed4-884e36b276ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:20:45.785378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8295-2d07-4757-8ed4-884e36b276ff service placement] REQUEST_METHOD: `GET` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:20:45.785378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8295-2d07-4757-8ed4-884e36b276ff service placement] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:20:45.785378 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3a8295-2d07-4757-8ed4-884e36b276ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:20:45.786417 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-ca3a8295-2d07-4757-8ed4-884e36b276ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:20:45.803485 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a8295-2d07-4757-8ed4-884e36b276ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:20:45.805383 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3a8295-2d07-4757-8ed4-884e36b276ff service placement] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:20:45.821817 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1441/2897] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:20:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:20:49.092672 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd556466-abd2-4560-bdf1-51ee3a590674 service neutron] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:20:49.094140 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-cd556466-abd2-4560-bdf1-51ee3a590674 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:20:49.163369 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd556466-abd2-4560-bdf1-51ee3a590674 service neutron] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:20:49.169065 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:20:49.169707 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:20:49.169979 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:20:49.170246 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] PATH_INFO: `/v3/users/1da9b695ec414dce9377c4227348cc8c` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:20:49.171535 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] RBAC: Authorizing `identity:delete_user(user_id=1da9b695ec414dce9377c4227348cc8c)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:20:49.173517 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:20:49.223177 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1da9b695ec414dce9377c4227348cc8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.235522 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1da9b695ec414dce9377c4227348cc8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.246024 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1da9b695ec414dce9377c4227348cc8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.253321 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1da9b695ec414dce9377c4227348cc8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.253947 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1da9b695ec414dce9377c4227348cc8c'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.260291 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1457/2898] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:20:49 2022] DELETE /identity/v3/users/1da9b695ec414dce9377c4227348cc8c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 18 21:20:49.441420 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a8295-2d07-4757-8ed4-884e36b276ff service placement] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:20:49.453695 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3a8295-2d07-4757-8ed4-884e36b276ff service placement] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:20:49.518390 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:20:49.519155 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:20:49.519502 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:20:49.519866 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] PATH_INFO: `/v3/projects/5e04e1ca61c448918ad13af0d72320d9` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:20:49.521060 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e04e1ca61c448918ad13af0d72320d9)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:20:49.523117 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:20:49.573085 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e04e1ca61c448918ad13af0d72320d9', 'request_id': 'req-b04bbc7e-2014-42f5-8945-d9eb9402b86d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.582034 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e04e1ca61c448918ad13af0d72320d9', 'request_id': 'req-b04bbc7e-2014-42f5-8945-d9eb9402b86d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.588525 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e04e1ca61c448918ad13af0d72320d9', 'request_id': 'req-b04bbc7e-2014-42f5-8945-d9eb9402b86d'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.599322 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] The token cache is being invalidate because project 5e04e1ca61c448918ad13af0d72320d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:20:49.599603 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.600243 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.601777 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1442/2899] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:20:49 2022] DELETE /identity/v3/projects/5e04e1ca61c448918ad13af0d72320d9 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:20:49.606011 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:20:49.607788 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:20:49.621455 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df7c3a-f688-4d4f-966c-e09b7bd632ec admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:20:49.682370 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:20:49.683052 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:20:49.683330 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:20:49.683599 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] PATH_INFO: `/v3/users/7b196a5c76374336bca64646a44f29ad` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:20:49.685350 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b196a5c76374336bca64646a44f29ad)` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:20:49.687359 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:20:49.710078 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:20:49.738616 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b196a5c76374336bca64646a44f29ad'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.750208 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b196a5c76374336bca64646a44f29ad'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.763380 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b196a5c76374336bca64646a44f29ad'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.771712 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b196a5c76374336bca64646a44f29ad'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.772481 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.notifications [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b196a5c76374336bca64646a44f29ad'} {{(pid=81587) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:49.779186 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1458/2900] 10.222.0.59 () {58 vars in 1224 bytes} [Thu Aug 18 21:20:49 2022] DELETE /identity/v3/users/7b196a5c76374336bca64646a44f29ad => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:20:49.967272 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] Authenticating user token {{(pid=81586) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:20:49.968745 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.fernet_utils [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81586) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:20:49.983904 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04bbc7e-2014-42f5-8945-d9eb9402b86d admin admin] Validating token access rules against request {{(pid=81586) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:20:50.044093 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f68b08e3d424c04b847f9123ed23bfd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4e6b4204a03c4768887ce19cd521bf6b', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81586) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:20:50.044809 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:20:50.045084 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:20:50.045352 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] PATH_INFO: `/v3/projects/82922a34d20e423aaad0475cbe52b759` {{(pid=81586) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:20:50.046514 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82922a34d20e423aaad0475cbe52b759)` {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:20:50.048634 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] RBAC: Authorization granted {{(pid=81586) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:20:50.069672 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:20:50.097574 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82922a34d20e423aaad0475cbe52b759', 'request_id': 'req-2447ed10-ac9b-400a-a153-d6bbe77e1f53'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:50.105458 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82922a34d20e423aaad0475cbe52b759', 'request_id': 'req-2447ed10-ac9b-400a-a153-d6bbe77e1f53'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:50.112159 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82922a34d20e423aaad0475cbe52b759', 'request_id': 'req-2447ed10-ac9b-400a-a153-d6bbe77e1f53'} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:50.122869 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] The token cache is being invalidate because project 82922a34d20e423aaad0475cbe52b759 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81586) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 18 21:20:50.123175 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:50.123840 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG keystone.notifications [None req-2447ed10-ac9b-400a-a153-d6bbe77e1f53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81586) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 18 21:20:50.125367 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: [pid: 81586|app: 0|req: 1443/2901] 10.222.0.59 () {58 vars in 1233 bytes} [Thu Aug 18 21:20:49 2022] DELETE /identity/v3/projects/82922a34d20e423aaad0475cbe52b759 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 18 21:20:59.775548 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:21:00.119838 dv-cinder-852208-8-iscsi devstack@keystone.service[81586]: DEBUG dbcounter [-] [81586] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81586) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 18 21:23:59.125557 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] Authenticating user token {{(pid=81587) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 18 21:23:59.127243 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:23:59.275137 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b661e-81b2-428c-a836-32c61e58d61b admin admin] Validating token access rules against request {{(pid=81587) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 18 21:23:59.335120 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e319356-caa9-4644-9c20-961fb3b29dea service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '16a4ba52fe124009a570fd1408903cd3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '7702a90e64d84abd801b7c3fdf694d1d', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81587) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 18 21:23:59.335750 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e319356-caa9-4644-9c20-961fb3b29dea service placement] REQUEST_METHOD: `GET` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 18 21:23:59.336020 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e319356-caa9-4644-9c20-961fb3b29dea service placement] SCRIPT_NAME: `/identity` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 18 21:23:59.336286 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e319356-caa9-4644-9c20-961fb3b29dea service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81587) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 18 21:23:59.338371 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.fernet_utils [None req-0e319356-caa9-4644-9c20-961fb3b29dea service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81587) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 18 21:23:59.352206 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e319356-caa9-4644-9c20-961fb3b29dea service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 18 21:23:59.354059 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e319356-caa9-4644-9c20-961fb3b29dea service placement] RBAC: Authorization granted {{(pid=81587) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 18 21:23:59.364408 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: [pid: 81587|app: 0|req: 1459/2902] 10.222.0.59 () {60 vars in 1365 bytes} [Thu Aug 18 21:23:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 18 21:24:09.360403 dv-cinder-852208-8-iscsi devstack@keystone.service[81587]: DEBUG dbcounter [-] [81587] Writing DB stats keystone:SELECT=89 {{(pid=81587) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}